


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1998-06-01 


Cost benefit analysis of distance learning 
alternatives for DoD Uniformed Personnel and 
Civilian Employees 


Sell, Marge M. 


Monterey, California. Naval Postgraduate School 
http://ndl.handle.net/10945/8164 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
(8 DUDLEY research materials and institutional publications created by the NPS community. 
«ist sae Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS'‘s first 


INN KNOX appointed — and published -- scholarly author. 

| LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 


- 



























BAF 8 OLS EB ed a MAaiin® 95 08.5 A 8s O88 
re 


s4e Sraeege 
hah setae Otel « 7 ee 
setae pcacheaseasyec ae berthed + —_ eh 054 od 


Tat Aw beet saa) p 
Wiedpie BEGG tet. lee TET TLS ast 
b.Ver USS wert eM a Horgaes (asad 
agar 14h eit aye ay 





















tides t. sane 
{ srl asthe aa eis F 
Kyte Wie Sheoe oy rete 






























os 
; TE ee ee 
; Bag ay Q atu Bt fey ara 6o ie viotabeh Lbsaeoaiye 
(Pepin a | eet 6 Bt ty b ey \ is weeds haa hors mi ‘ woes oo 
Sond 8 awit -. ees anaes 





ca MS cried 


o8 &, 109% Ohh sy Tok Nila ibaP 1G. Hh oo 


% 
ce kl wt) wh A. 






















































































































a ‘ ave" 
: 4 : ae o.¢ Sams vie hint 
4) q r au Gag, bceade 4 
| Vee és Th f ¢ : Se ibe ia ies rants ing ag? 
ae 4 5 A pidte oh gle i 059 as ats be nel <#asieg 
ty PS ARC H IV E a ; aia th Prete t st tng aad ad de siieed re acraat 
4 ‘ “6 3) : a aig a aye: ar Pitas Gah ST prices 
A 1406 iy 60440 ed a 1 Bs! etal, atta ayhrias: aah app bebe Canes! : 
4 ' tbe | Me . i Leh) PRAGA ee ste ssat S60 2 mda yas ee hohe ty pera ee 
Nebaksb.di bg 92 heap or ata tLe. chee aiteace 8A Date Lin Seta O2k Mado Ps 
Mega Fy thas hes AR 2 - ae sia onl tw 800 Anan Wanted dao 59: PB of 
u if iw dye Darian? she WAY La eSensed pease abso a pekeae oedea test 8 en Bat 
. A hear ee ao ST ie pant 2} “puantte Lid SPAS kes Lt 08 i Po bannte heft 
wider . uh f ; ‘ nah O stat Slate UE Dy) Perera He invaic tek drepeadsbcastpnanesaclatas a 
; ed visings sth tea tt ‘ aes sa ny ek cesec hee tao vt a abel ad 4m AA ete Sey 
. yi . F ’ ri fot. Smee oe oo 
tease tae Re opts 18s saat ie deen salt. ets tive thy hn. ib Asti Norah tasteless eats aa 
amar ee TMT atte dee ul dis. oS as i Pama kg hau oFAh ated oF 





. 
ies i'w ogtaa dyes 
154 Mate. waite hd 
a thd 1. per, ¢ 
4 Gy OPAL haat ura | 
















% 
ob 
riils ey Mia! 
































































































































































































































































































































‘ a 
. ‘ . ' 1 . he ee ee ben 4) 
' . a “r,t P ten a eye Pa Ciera rd Se Ce or tbe im 
gee ace 4! seh ie Nein mao “aoa Lp i sicuntinee, arte: 209 bs te he oh ety yl Biah9a 243 aid ch 
noe ' : ee ett, to ' wus ins mn 1 ee} 17418 ra 03) Hi Maat ie \h Me “wi Ee # 
Cums os : " hua a papel te} satea, a 5 14h lymed . ¥ 
' : : wae Bi “ab nt Tsk ts ome ao hemes rs ear ane Bid hay: masseevatle Rioinietn et: aes eth 
‘ @ © aa ' . ie ope eagoeyrnaes ) » oak o, “vas ab Ty abrvege. tie. 4 ee j Espa. Mord 1 te nyt yeh A AIO nt Son 
ee! ' : ' ' s) 0) ees GPs at Na gem area NCL y ret tghaai, 9 bedi Hobie be pe tape teathet a head 
Peon > Ga Severe ieee we 14g? a, tele es aot ee one pyeete Sy, iA AW Daley hes ety 6285198 94 pubs 
. ; ns GN actus é onc RRR Van seta tat chy len yest atse 
s ’ . a4 ' «tert " rareet ty agh) gf aeet | See ee aa haa Blane Ont N waa Pek te be Bi te AS, 
}oeroe 1 ' ‘st ’ Mga pal seta ale wee! at yiet Se arttaphet beh Nae tia a 894), 9.4, 4:8 19-98 8 ota+ gre? 
pas : re tat 5 Pr a 4 ’ ARGO PEAY behest whe oi = A nig FoR Reber Rahahe! 
“ ' ' . ' & : j a wong? aftgt by Serottd ; ee s‘orsra 16.8 ACA Si cela bg bo da® -& 
’ . ' a | f aol Tye phgpe Hien d he s * : rt 
a ee: mo Bt antl Hie pic cae sean Bator Tires Sats 
: aot BLA oh 08 8 ate oh Sat taee be st leh AL Sons Ps bap te Gad MONG Lee ark gt grate tel el Lh De 
; Aare Ae a : a RC ance i Pa Tee raehig ys . 4 gil Tistang siakeetveea-tetgieles 
ag : ‘ oe us voy ay : . meee at late e ae esl neetie ‘ aanhety! Segihtreg 3 le nets 4 aie ig td, =e ey tea Oo 
. . 1 oe . ‘ wes. er Wits i s hah A ob Med fo! fal ‘ed 
4 : es re a) Seif ee a seny stabs Get tenance |b meta 8 eg) fe sehen ahi Aciae 624 tp OP LT a te a the cor omy i 8. 
. oie Renee . oe F Hata iesreNerherer i: Ty star cc 4 A gaat : A Vit lee 8, fis. se a ass ielstaeees ase quansiees Seo 
et a at Aiectea ‘ UATE side sayngteas o ‘ibe 5 Gt bicbeal a ae Petty ar ah ALS Y ieold Mada" ah an Lr aa be Babu 
ae Ke A ass taper te pe By ate . 3. ‘ae r ; “s Te ne ater rn a8 oe, 48 4s) {ha0. 60m uh, bated ae Pinion ern oo Sseneane ok 
vt ' vdier Shs D Rateb ay be on te runs) be ou! Tera ses a Pe a PLAN, peat Cente pret oad 
hr ee ‘pens a ee Pardee AE FO, th Se Made Sihp , Shae te § apeaineden at oN wsteex Were Ade 
»% eo s & apa’ pol'ie © oe wa del & Fat ae “ Bvahe te! 1 Ree oag he a8 AY dae hued) oe ieee borlan Stra 
‘ » 8 C Acris baael od je He gt 1 PS *aery aad ate dest st 4 dated Fhe pr Lg jet Reh l@o" peer rye pak a ~ 
. ve we aD nt asthe § etyht er Moa otk PCa S ine ESTAS yeah aces god tab eeActen! on doa 
. eo oat aURO RC reds nang ate re ee LA evn bates ales dy Vistas» A eR eR SO od Me bah HORM DNS FOR KM, Mg dt eres oll, Cae 
ache ae PAR var ; BeOS I eitha se a Ns bets oe gra zane qual We ei caper ‘ sit meres ah gs Aste boar vi Fabri A Pte Rae pce et OT 
: S Se AUNS rants ary aL: ER ee cae bi Fa Ontevi sa 3° adver Aa Sal eds 91%e Sah mate oh %. Dad aMeh abe? earn) Wieder Pes 6.8 
: ! ; A PORTO ee a GE 4 ie ssh “ie re ha ttn Mose hGtIO sd 6% «a wal. Abe at anens tah 0) id Cee, EV ihedcmticte un oratione fa™ 
ine i A Teed) sor ’ yous . on tot Datel 4 F ed . . wee ‘ iaetaeaa ~ ee ¢ > i; ay Gere 1. Nhe a : ad sag henseois Samy y i} is Te bare sve bath sa AW bead ST, t An tad A ae! 
. . . “8 . Soi eae as M A He saan ane Hy th , ‘it Au ed ee P Aga Hom 4h .. va Achebe! was tsi. Sy Aah esetiba mad nag te pg bila entestind Aa ad 5? be Any tne Oa? nal oh, Cow be, fe eens az)! 
CN AB ese? ai. ; Venera) ie sey SAR Oe EDT ves Veet ap Ce, ade cae Pte ee PRT eee ah Helen: Aare rite oe en 
' ci ak ® 
mle ' o ate oa get 0 vats » t aerial y -* ats ae ithe rar es ty ; Ranaaehs Pi erie To haiteb 4 phere lated Rap etree hdmi bry 
pes pts gaetesies tne A at “! i alka on Feet ruth Aes ob whet a kets, EN arhs Gada fs 1 9a ad Ay 6 os ak peste 
ii pr ave ter . the Se Ath mites ste Ye 9A sae ith? Aa Ra Ad tcdad FT ne et ee 
tn 4 wat (evbo dn ar city ehaetats te Aah Adu Gok. 2, Au & hives an ihotek find 24 Rh Gir ndhg todaama’e om 
a¢ paste ialeh ape ot, Saree rp FhemB Iie’ Cal gteh FAA RS bong pre ipa trarr~ pl 
‘ : RYT Ard ta aA Sata Sattar what 
ea igus “angig' i. ai Ce 1 Sercuwt a Spaatibanvanee PSOE BOY Priaterstete 
f . ' \ x ‘ Aste 6 S0 Ve he Fare | VA ard = Bs Wg Fe RoR Latah gs 






ie taley Ihe: Yuhyt 
‘ a heath obehe Bs 1090 VE 
us eas® Maha Aas Dh Aes Af Sees se ort Etre hey 































© dard Vode "gh SF. OL oy Ay Se eaeuizi 4 it ore 
Th SU RTE fpeelaet bore Aary ton nates dts Sita 
tone tg int en" a oN ats tei: i Se bar tbe Yr Pie 90 © dotatme UA Rite Kp 
eu 4 4) te Rae I hebe 9nG BA ts arias Kathe Ste be F Crate! 
Re 8G i inn a5 acer ett) 





aie Mo cdse Ct fen ee 





Ba ele, babs Lea Owe 



















































Tiss ghee 3,0 Taha’ wae fe, ve ; 
MRA tb yh praca ete rer ee A tartbe ty bryce Fe ee Ee OT 
sigs 4 Mat alagal HERR TE § ; : : i 

ed lek, iekgred a it Sah Baebes tAsAshyocebs 3g.4.43 bade’ NAAR Cae neta eteens Ee) 

a deig dashes larghaie to stidrys, oe alee: agit! “a4 Sita asia vii white 4420. Se er hf wire el 

aaa Wie Nive VEN TACiECS Nile sancti? SN at teh Big re | $:\sSebe he bag APY peo fe DR ear pve ree Svan oo oe Pet a it 
1 eee 2 4 1 eet trp meh ahs Sihaten abe de A Meklhy a. dake TslyqnedtnubihancalFetw brad ea» wigreegestpiees gig BY SENT beth be wie ry Racy aA te ot = 
ee RAS ‘aeeaa R ein Sete it ta vA Tarte Tal id tad ote s det \%,6, AF eats vat a4? ate tt Se vie fete Aad HIS the Sat ori bee ba cp etn te 

1 | 4 : , ~~ . . . eft =.) ' ¥) A 
Aue O2he% obs SPO bette Ae ty ast oes Lav T | . ” ae a ren srectr ich ue Seana Te — 



















+ se pts i Sci alaing eek 
rr) we VIO WO, 
Aa bat 


Udrd 1.4 Leh 4 6% ft 
melsmee Tes yo ? aT, vias i err 
% « Meu + Bed 3,849 Hy adish Mage 
» ets, VANES 
GIS ATER EA Teded «& Unt ste 
era et rhe a Sel 


de hed Seat tate 
ate Dt he pote 
leat fs na beng Se 

Wh sie the teet ten 4 
bets ee Tr 
say sete $o aie ed 


a es Paciapre hy 1B eg at .BAd 
seen Cre ee i ee eo 
Che BGs ale W a ak A166 «Herts Pawns t''e Ste 
429 MoBad Mme ete bs pa the l Veh eh oof <8 
Debate Renthrhate =%- Hor PS REMC rh ee et. 28 
























bee Faby tots 




















ene Praews a’ £ 
peqetl: bye teeth, . k if ‘ ig 
‘a #4 Re stn) PVT Rag SMTA §-5 he “h oie bs 
ste BPegedatu sh 4% yi oe tee ee 7 ric re ence SB 
Bees aA Dt ees Y ay ot pote. weber Prt fat S&H 









avct fhe Rasdal eh 
Sehr oF Ce f 
ake a atl Wines ot 


: aghast aga Nyt ENre': 

java asd Qed inks aS naemeene beh Peal 

S,btle weed iP L& hydee Late & Ug tesees. FSe 
atthe wr 0S ores bb Pee Top MOU CeO 

Pe st 8eseetog hs ayrane es Poe Td Cue 

My! Behe Mehet. fats tet 

* Rats Mine Jere 
: ta 


Rat ath) dvmandhe! oe Pelt eS otra fl de vefh ot BA 
Raaet 6 otk Meh Lewes prpcibte oee ne 
hah 2 8 1 3 aa Cx sa 

Gate ro hata @ aT 40% . sO = Pig mae See ® 
Mire Eee ee ee ee Pe Pre ri 
ase 9 | ae Pista Rats Carrcde Aa At 

Xe rae aie at wen Se 
ae “N69 *. Sack tlAee Sr Ne dha SALA 
’ 
we 





POS hl fe ah aed 


Satale Sas» 
labs rey: “fete te Tg ded 19h 


























tae 
if ww ey iy + 
1U the 180%, 

(] 











Matte dedi tslah Goebys 





steosbe® 







































te chahtle vt 
np: NG q ; bt Seat ae PES Pe BO Per ENT Pe Par) v3) 
se a ies I vs aie ye Ee Vere pions Beteteres Shy Faith. eh SUP ieee 
web absete & Apdetanst a Wed CTT G sh wat tag hy td Sit Aafia petro ee eee er Aiea AY 
e's Se CYL it te Yates. s hee fr O4- : . oh Dara sha aan hs Lhe" ssoes Sinker W sane 
. Fi " . 4, of. =» te ® s @ 
2% Har w.84€ Tete algte” Ese 2) gyh 4 4.4i4. > frobee Deve wa ay ths dw 
NOhy Ode tis 8 ate A Sg igtPrae 7 Sdacd. hataty” by | aire Fath SETS 5 aM ob 
t Fe Metadete™. Stele ie 





4 823i ¥ 

we aay : iat Oe a é ah yin 
Wet *78, 5 1 PS 

oped teres 37% “ad 


oh * wh 2 
Rie RR SAAR ERY SG? gle 
= 


2 AaH 8 s; Scho * Ar 





























Ss . 4 re | tts ‘ b| 
. . pe ret 2? * os > 1,8 a : ahs ah 4, NY age 
. a . . on be | a9 eat Le | 
’ ~ F] e . 2 . 
ers eo. i asad st 
a , Wi etre Shor Author 
ee re er ae Pe re bee et 
ax hoe F Pere: e Pe A TAS AE, eet 
epee welt sar 7 picttget int hice 
. ; qfest ots WA cick tet ststens fet, 
: ie et TPL: ads blip h Nga tata te «tel 
= . i ; ast. aaat $ Wek. Gt -Oe So 
i i ag tf atily Vee eS 
: © . , ot 5 Pot Ad? « nope a Ee eS 
uy i cae grt wer ahh 2 bee ate tt BA ate = NOS 
Ache $3234.08 3 Be Aske oh inte ete Or el 
; 2 cua 'y Dee icc (SpE LET CEA RL EA 
. 1 oa ie rie} “(Ags Sct ore kr Re te 
aL i 4 She besten, bat ath SUP Ste 7 < 
a #8,% tet tS, iB ai¥ of ‘es 
a Past e* 




































q'¢ asde 
3 4 ate 
‘ 





a, > 


‘ 
se 8 gan gaa 
1 e1 







Sesh f 


“A 
¢ 
Pome yal ori 








= Ae ey 


Br. aie ee 





are 


, ae 2 

tet gee r = i G 1 

Paes w NE et, 
1 Sag 





seaatg” MW or yy 

ae phe @ 10" a 4 A alztve 
" 4 

afigs s Sage he lk 


eter a%et de 


Pe Ne ta 
' 
EM ars 































4 
4 Cag? Potter 


stedtenl © Fad a, 
, ‘ 
pokes ene eeseue) =) 


‘ 
' toe * hety 












































































































































































































































al | J ‘ i 1 ’ Ts) ge ' - 
ae i | re seMny te Oe \s ° 
. s a 
a : 4 Hea Hoa pee PCH a bd 
‘hem ! “ais ae i, 
: ecg :* Ceol fi i . 3 epee ci bl hd Oe 
4 . ' a Se eas eae ‘ ‘ ; 4 iA ie ae fered’ Pig Boost ae? Fa? d¢ We 
pee va 2 tal. ‘ ? ‘ rats Cth ieten hea ey i PRET EER STA ¢ 
A We \ repose ty - "OOo SRe* o52 
Jee are re a there te Rant cee ar? a 1 ps EG 
¢ Sere sie egerenee Be a“ C.F fn 
ate tenet ieee et neue ong Way 657803 rd gh merge 
‘oF Rotts PMI RD" GTR GS 2% = dat 
i ee PL Se Si tek 
: vgse et te at LOE, ere ee: 
ont ? Sa ee eh . pee ligt A ah 2 
SOP ARG COE ie IN pedipse ar gate 
a tet ep tat OF ib he pine pont oh ae es 
: TTL Ar NR eb “4 aint oft iAH PLE! oe rN ass y 
+ gee es 4F i] AS af *45 sy aoe Re smyaptgre ga” at, oats 
oe Coe estere yur i iS, 26! ts 5 FL A091 aver Oo LP NOR ia ae 
s1p52 4 hep 2 SF afi SaBi ge Wesatsiee ‘rater reerereT®, +) mated Sins wee ee 
a os 1 Ste? . oss ee Fe",' ee Set 4°? x rprye gegen “gtatyt tae! akg TNS An y,*, Poker! jo. 
e eek tata ty ocr © ge eth target gays 4 Ate pire "Meee hee ree “te Be ve Nie - saat Aah} “at eo Lie. pera aes 
SBC e ae 8S) as ‘ . . F] ’ . i NA Ante gts og od ee foney? sie" Tek baht ty cobs Paes oh Rez Di tes Pp GOV Toe s oa ov a 
’ ? ' « - 38 ter hie rd a wy “i os " fs cae ' ! ’ as i , e " ae a opie “ws 4 te as at's al eeeryareae eg: eggs seh on “on: Se PAE sicaneners SH a cs ay a 4 ion oe? 
Miah ft pevopete. t* o« ’ on Pe ed , get eae peg 0 geys xf age hile cacsiiabieses “ pages 8 st Rpt Aare fs bet 9 eet pra eins rine fae 
’ Seian os Giese cd - h : a 4 ‘i . » , pe % a, = Bu ree Cis be ai oe io <, 
Very, ae mee Fe a8 ee! ' vu t oF ; aie ” ’ ‘ rd oh nea st ong Dre ate : pet , 4 PAS he es 2A; rraiyeg nu ed i iA yas OS ASI cee = sat aris thea pear segues ee tpt G1 wayrgeeracet ar agegey® ene ferrsere ra 
ro PEytsy Sth Uae trcn oat ‘ F Efaacety ; ape Ye aR ¢? Us is i aeeate : ee Te hares 4 ergnpeaeyae 4 weeny agree dtd 4 ects qminere? weta “Tie moe ao Greed? af 02? hae Aaaeed ahead tsa waeissene ge 
1 ' on Pi-saeleles ounce uns pose ingens ’ ‘ Fi wipers etecamgeg EME hy gia te abate CUM ate Ua tata Nien avers alg Bat A , pes spl fat Pie aute oF Pe a) 
Le ed ' ait ene . 1 : Py ae : a8 °?, en perp wis Ae iyets 2p 1s S49! ge ary ata 9 e >’ bead art wwe AP? ee? 2 ia 
: ai) onl ris a) vba if yar ar v? we : ve ar ny ‘ Satin inet bans pare ye . Hey ¥; NS t aetXotvoey res He A ne rr Fag’? 4 gl Ba eben ett ae st Be pa a 
Feet cts i re a OL Perna earn ET "" , : Bethe ATOLUTe mere ee Ter ety bye nye Leta ts ti Her in ge Dey Revs Lek te ip Ph Are ge pau) soe gt Bat pat cpt he ett 
bezel acer e elwey sane vO F CS ae ee ae eh Syaetatinenyey oe rane Ges dents pe gey' gy bgt O88 five rns yo) « rariucra: ea" Tai he Med Falter oe og ny Cage eet Care @ a eee z” 
pe ie Pe SI RCO Wea i ne a on eg ne a re ay ch ate May at das tf ania we rer pars Ape Ssessatt mtn, Perec re ae 
a) ’ 1 F) . . = ; : J gnye . areaeae a i. ae | Ww *o" é ° : 
1 fe a eos UF ove? a a oe Pa @e tees », t “a abet! co ait ate He TiN yA 4 ie Ar ae we Pee Hyg? = avs 2° 4 ” Fe ag hoi ay a ete A Sialic ee 
! ‘ . on 1 ’ 4 pede 4 te ys ey ge pat é ia! t 7 
steers acer aM a NHR iia Str ree yp ety Th LT ae ee Bn cide Weil tego sie prt hie 
Ce fect S Peat . A a epee 1 aaen ts the presets goryt des yea ating. inh Peng 5 ety ; i an ‘* 
ta Fats SCT MCAT eee eI ie 1 F a en ee pena es eee a ines fetes He esp apen tena Ke i obs 2g ty NY gener Tere 1° Sa84e 9 Sabre ot it Sy pala ae pO 
vs ‘ge a aah re EI ara ee barber eae a ie ty yoy pins Be ilheaeones re Peat Hines ae ae qee ead Peepers t rath nak ramevtee tees P Gtagpetser err een vt 
A. hee eta get a £ 5 ye 2 4a" * ; epresyee yee 2a7 (Prat (ee? - ’ . ef ¢ 4 
a BORAT bales as erik pine te ae pe tioe tit, eatin es 183, ag Pip Mar ae oy Hi ae riatyay) aero) yers Peery ty y WaslCh pe srgsleg mages t pede M0 ORs, og? 8 ge Er ELON INF OE ptecqn er: ong rerar: 
meg pte? ft Ce eve oa ate al 4 ; t "ot ip verse Fy fob qa tite ak a0e! ste 4989: od Ine rlges ter atae, sarare Fie hee oof ah) tae roe ek be ket Mle A res 2 Cp ne nes fe tad ital h 
ee Pe otetr ateoe ayy ; : opty’ tQhe be Teen i Ty Bes ed gt yenns pale Be la bat Sa a fra sak ebaal se wan hrs mt phe ol k 
Eh parse se {3 ETAL te, fe ale fae « eae th ot eh At Phi eh et A fg Taee pyre  * 






























sey acucacesd 3 5 yen PT ta aed aie 
Supe sents Ria rene eer rt 






ote phe ady/o* iba et et C Abel 
wey y 98 ie GE Wh Oe 





os 
eau crikag, ont Fate ply Wie ¢ . 
Da eo neg Pur eerie aero 





























































































are ad? to st ereee a Le iek aa Doe: 
t Pe fet ry ndibt 5 © esa! 
slg itn algn oid melee aa ges Monee ee tatyta tiereere depen tony iit needa Meme a tcreneeted 
Patels s eit ere yee ba 291 it ary ig Syren ae stage eal g UWA de ; CSREES eal 
Beenieess A Pecunia trams cunt” Thor Py 1'soy8 dire Fuvkes punt ee 3 Ue. wpe Po heii} EA, tie pe neainp de) “= 
eee ate arate gat foe Hu Para ee ee ay eye Tee le te Boke teats de 4 : 5 sep fear pit gt bel Sptonycn rare nn rom tye oan eit Sn ec. cele, She 
“> ne 1% Cu! al * oy ged ee ge sa i, 3M } iy yey ety: ink habe a bere Hyatt Md Di fered og ha Pi canna! eerlenis ser l nergen 109 % ba sd eas * 
148 a e “4 AY “ ome .: t ’ re" vet ot 
Sr BR te By aL De MA He chk ioe ; a Ae ga "eh er Syhg heresy tad yet! Lia ptesnte syebegmenacgFyrcg ek TTPTe Tete rt us 9h, Spe g oe iB" ee ppp a a 
Hf Cal Ae fe A <a TR BH them begs te “poe a? wae ty Phe te bah be hel pa Mi shat bys SetanoebeaSortae'e worneracaett » 5 Oh Sens Me co sca mre 
yoo ts PL ie rt PY Poyeate 4 Fe ape ete t seer 8 i ‘a O78 sagen rene vdegiutstaes oy ene bet abel FSA aed ney ot bolas Ha Tee iitetee ee Paths stars 
are aisarat s ; «: - Sens oe? > . - Leena 
POO Pan ic Pa 4 AJ oa! ar i tote ene aye tecyt i, ba Wayne meat fm o DMS DTIN EOS yore eee hy sabes reshtatatan cars oat sith ss ce htats ere or 
’ pda Fal 2 9b oe Ye A yryt heed ve ’ one y Sone he wea be Syide ois ite aor va of re era: “ ki Et 10. RAM La haheala, Arata 
Pee , false TE UE tee ts oF ® F1VOSS gf ELA VP EMIT Beet e989" Speke tga! ph ad nicer espe Fie hte Petes 
ta het samen atop e perme ye N OO? ee Be nay VO NERY 


Rea? ha} 1G . Teeth, at ate 












i | nee oeney bey tp ie age, i noe 
% : eras PEM" OD My asey BGPP? IEEE Pie Pi ROT Re ee) Fa 
yo eeoee Ver Ly : , “Ae sree ytg sameness arate emenygite “4 were pee ratae eosaeee arith siete sey 


ote tity 1 boop teen elateey ages & a? ata 
a 
RAE Ne ae alt hid Oar hs Bee lees ene tna be) 


eae trian sip tat anes 
ef Mie or a sth ebrry, 


‘ 

OOS cee Ca oe ae 

i tn sey Bete 5g? totes aor 
14,0 10g 2 yt parr are 2 teed spt 1 

















a on Ae TL ont 
a yy aD 










































































x be te y4Xe tt ra oye bak A * tf 
¢uteAn es Gee a Oe ay $" Fe thee Tots Q% wo wes a oath late eeerret! Gate Lon ante ows rr 88s avy ig 067m orzen Md oY. <s 
"ate ean gs by gt eth aM lee! j 8 oe ¥9 che REC eT Sek ober hy tale Sa a 
YE sts) os TE eels Pate vive OTE eke ie he Sauna a yeas anette YN yeveb ornare oe 
Pe aa aes orb ee HaENGRosla ee aMdlacoone Ne ak Cop eaek rae ay Ona RP? Ionia catg 72 ark rata tees Mere Demeeyronsh 
ao 1 Poy Aen ar paeeas Ves We ype ® ptbeae ery MAIR oS Rated be head eis Thanh et ela dat etal hand “a 
ayy 1 ate 2aer! piaastitet sony Retin ie sob arteaee te eeeat 24 agty re semen Se otte7 Bil fas tae Ata 
wo _ H Fr eo. f ‘ is Sara dat fi ao Ely YEE een rh uy cyt Te ‘omy 
ang 8 ace ‘ Pe atatite get) tee é OWE a ee ayant tyme Py 8h Mos ged a Se kata ate "he cre 
Ae oe Avo ne inereeny cock 1h BFP gs oh aye Bead He ree oe oa a ye + ala 
. Leite et an : ase 6 tay seat r ate is ness WP ay iytows Syncs -aeee 2 oF Lot ab oy 
$ tet hm PUe TT Ey ieee) het dar teh fae! et De TL tee tad Fi dada ap Rice Scania 





© fis * * . 229 ob yh er a, © ae 
sateladatedyeecan Spe riceie Se arama REEL Ee sy! ee Share Gk arctan onsets anya FAI 


geeteta ne Q teae SEU ata EEO SF 


























































































































































































































































oeea eer ae ae oe 
Ly ee) oot ’ Lite he a myer 
4 tp prey f ysaey wee La et iy alg ot aK Pcl 8 i 
ie erie CAs aT e nL apr ate oP Ata at ny ite ea realobam spate hice Ob SeasrCh Le iat Seat ats Sites Wma th td 
A ete RAIA nishre isla Ht 1 "ate ba tety tes 14 1 fsy st Anyy ' eg?) OY Ata “09 Ws ee : e' 3 4 =—_ee gmat 2" 
. a ae Lcewemmerliet: waa s if tpt. ty x vey deethae 33), 510749 ee aah Wal eM MMe Me ose ry we Seta” 
. ae Ld : aca a ce 5 ye ' e, eee t, a i Ah as mie gta ee raat iva aly ihe ya ." * eC en yt ph intelyiater ees Opeth bi ate waa a ic, tere Le dit Lee agasee cant 
da ue i Liecie Tier aa * ‘8 | diote Peete th +? oft yiqee pie a pptacne Ct ot tc Tk Seat SP ta Betelaa lh Ves tate Re sarkesnt nine rarely adh ele a nat Cala eT 
ate See ye Ear PMR Dearie rete TRA arr. BeOS BERG on oe 4 eats Varese sens akg stew ip te? | ae TT ro Le he hacia bt Fees ore Je PL a da) oa eyiese-e se coe owl oe “1 
ie pa re eloemiy tain (elas ja pa orp Binh teams oy 4 dys e! e906 § Gye 4 ” sare ” aye LY Mea eee KAR eet mora td te saz9 9m 9m mares cree catainy 29) rps Spree 
te wae a oY : fae eon Tey Dae te an ee Yel De De La Cl ee re pre 4 a at eA: "yi es “abd, We id Ad Aa abyraertae pee he. vee" es pattie tae ee - 
avons ate acer 1 ieCuCie et Le Ce ? serps adenws ! ' ‘vi San atv vino Flat hla ¥ Tr; tetera Bs bebe detent GN hee “4 epee Sesera wag ernest 
a re re ee ee . 134 4% ea rete ee uate ote 1+ J . Toe vrs : 
hy hivest Sas ‘ as “+ ; mete ti HpPamary ye o24% Febery He Nyce WR PPOL rey ta Se Hes SETI E78 Y Sayin ey Ap Taire wig a a oteca tow 
ie ke Sar PDR mm U LS rena ot Carb a Ges WAT Ab ri ee coe ae et P Setranin a teneeaee re ena 
Rabel Oe : oe i a F fs an , . th ae ta Meee ears 4, s o. *, 
‘ ri page Esihte our as eng nie er a Ope a4 ea or ve a V0 eo Bente 2 Ole iN yo is" t. rn Tae Se. My Bebe Mp He Paihia nite ha ba variant tie yea ete Ss 
: my Sige nt ss 5 & i s t = Balt ay [ht De he "5 = = . : 
¢ 8 GN ate Oe er a " an Hut ’ au Peres eee re astro 57389) etn meee H teers Se * rin Se oF ate ke ‘ i? a rabeyspea eye ie ngs erg sa Faas gees Ty reine a Ck sat » fra Sit Sate t: “$n 
' ah - . eh ae o 8 Bo aps we et Fs 8 ar 35: i tas We 2B ad ti scere pend amyeasyts ys any t ate Picsihetcn Sa ee ape RE ere PT Bynes wersiere metas eta Ween ORs 
Ciera ke erie ee a eee ce Oi rel erin alle eae os ans 2 8 AN, AE PT Te Soir Or tee he 3 I9IG* H : oars bem: ‘ sare sampras hes geo cna 
° Ppaves  @ tert ued Uge pee 5 . " s> 4 " BL reas ge gah eters tlh eye rin x Lda py te Dastevant racer on Chee “We 
“A *, ACEC oy 8 LP ae % vel 4 ; » a) " ne ha sf 1 4 ah baat 5h rote? wires 4 am Hag atte y ase ee ! . : Ane uae epi pelea seth ata ~~ sti atacen omen terrae tte 
. e t $ q ff’ % ) A ” <ywee”. 
Stes dE EE ea was au tty : * et + : eye cae ap 4, iy eg peated i grate on “gga be wren EM bets Sei emi Re meen aa ur ble 
Ry oe ee «oc Senseo : : thos 60d yell gy Mae eto hoy casey p38 een EAS Lo lak oh rehieeneyycarany “hyde dad orn a ben me 
AP Herero at rie acie: Be Wome oun eens a Tyee pug b 1 ee " atsete bea a4 ages a * op He SANTIS Ey a iat i ia es ta Mp 8 £95 2A PD BY is teen eatee ae, a oun 
as , woaite — ani : eke A A le iat a ae a Sh 8) Sintec 1 fe Op & Weep Wie <a aes .9°e ocd may toa e res erent ey aids aie WLR 2 Nam Witeei a arrase net an 
be tua io . ’ Cis Py | taut Pra toe re ar | Po i eae Mp Rp Bias Sk gaa iotstate $7 eke at * abe moat ‘gcettly fe eace bey oe yee od one eat 
‘ Bie t "aS ~“petysy ste 8 fos" Lr ee er } pee eet eel 3 Usted igri a aces Fea sea ; erste acesarsretengtenl oem Gi Bea 
cme ee § ial 1 fae F P ‘ : F apt wr web pie", 
* ae eee at PLP AUR ureter, Ages ew) PAM Pande 7 ye “Rear nian n iene x oiolas sungute r ee] etree (arancne 
. eT er oa ate ce v4, aks ita gta bee by a SORE A a) wetland: Sat eiia Sater dea” pose tves went aal sera speaee Fouche 3 shee be Spleen 2.46 A170 F 
TT PRET IOER Meee ea Cera an sd ate Sastetalecp anus ieseyrnt ee set yoyeaews aes Peay ed es PW oS BeR ETT Oe 
itenee Parca rst fesse Sisal ae ap tee oe pil; A ” eave? 54 9: 5 rt Sac atp aah! ie x a ‘a Pritt Unhh b 
a vig Pas Oa ata 1 : exis Lat Ves iy dye 2 ye , ‘ 
sr ach, Date Aeraigbage PEL ft Se Aue ferent Ana] ue "tat tes si its Ky is a2 yep! Lia Ee A acgeasee ereicm? air eh was 
en Ca | aE letetal eal oe edd Da Pans Hae 2 mayb sey > ta late he 5 42,00 Sisaca’n wtcrcryeeeermecn 
Pha oe ns 5 fee d das 2 AL) Sate oe wip oiht 8 gM A" bebedy st eat 4 Py a i i. as ; sep yiel foe yd eon 
a tT hh ete Ob bs “A Oat ow Genres: iseyzart 9-0 eS oe hyrareryeeee 














DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOOL 


MONTEREY CA 939 











NAVAL POSTGRADUATE SCHOOL 
Monterey, California 





THESIS 


COST BENEFIT ANALYSIS OF DISTANCE 
LEARNING ALTERNATIVES FOR 
DOD UNIFORMED PERSONNEL AND 
CIVILIAN EMPLOYEES 


Marge M. Sell 
June 1998 


Thesis Co-Advisors: Steven R. Lamar 
Gordon Louvau 





Approved for public release; distribution is unlimited. 





REPORT DOCUMENTATION PAGE 


Public reporting burden for this collection of information is estimated to average | hour per response, including the time for reviewing instruction, searching existing data 
sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any 

} other aspect of this cullectiun of infurmation, mcluding suggestions for reducing this burden, tv Wasinngton Headyuariers Servives, Direvturate fur information 

| Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302, and to the Office of Management and Budget, Paperwork Reduction 
Project (0704-0188) Washington DC 20503. 


1 AGENCY USE ONLY (Leave blank) Ze REPORT DATE 3. REPORT TYPE AND DATES COVERED 
June 1998 Master’s Thesis 


4. TITLEAND SUBTITLE COST BENEFIT ANALYSIS OF DISTANCE | 5. FUNDING NUMBERS 


LEARNING ALTERNATIVES FOR DOD UNIFORMED 
PERSONNEL AND CIVILIAN EMPLOYEES 


6. AUTHOR(S) Sell, Marge M. 


7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 
Naval Postgraduate School 
Monterey CA 93943-5000 REPORT NUMBER 


SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSORING/MONITORING 
AGENCY REPORT NUMBER 


11. SUPPLEMENTARY NOTES The views expressed in this thesis are those of the author and do not reflect the 
official policy or position of the Department of Defense or the U.S. Government. 


Approved for public release; distribution is unlimited. 

ABSTRACT (maximum 200 words) 

This thesis supports the evaluation of standard classroom course conversion to distance learning 
alternatives for disseminating advanced education at the Naval Postgraduate School (NPS). Distance 
learning is widely used throughout business, military, and academic organizations. Distance learning is 
convenient and gaining significant interest and importance to military personnel in assignments which 
hinder standard classroom attendance. This study focused on developing methodologies that could 
properly support a cost comparison for conversion of standard classroom instruction to distance learning. 
This study involved personal interviews with both military and civilian professors and other academic 
experts in distance learning design and implementation as well as a review of the literature. This thesis 
recommends NPS conduct further research to design a data base to collect reliable and relevant cost data 
to support future cost studies. NPS should also compare equivalent existing distance learning courses for 
coritent currently offered at various institutions other than NPS for consideration as possible substitutes 
for NPS classroom instruction. 










8. PERFORMING 
ORGANIZATION 











SUBJECT TERMS Distance Learning Alterhatives: Course Content Comparison and | 15. NUMBER OF 





Cost/Benefits Analysis PAGES 84 
17. SECURITY CLASSIFI- 18. SECURITY CLASSIFI- 119. SECURITY CLASSIF ICA- | 20. LIMITATION OF 
CATION OF REPORT | CATION OF THIS PAGE TION OF ABSTRACT ABSTRACT 
Unclassified Unclassified Unclassified UL 
NSN 7540-01-280-5500 Standard Form 298 (Rev. 2-89) 


Prescribed by ANSI Std. 239-18 298-102 








Approved for public release; distribution is unlimited. 


COST BENEFIT ANALYSIS OF DISTANCE LEARNING 
ALTERNATIVES FOR DOD UNIFORMED PERSONNEL AND 
CIVILIAN EMPLOYEES 


Marge M. Sell 
Lieutenant Commander, United States Navy 


B.S., Southern Illinois University, 1983 
M.A.,Webster University, 1985 


Submitted in partial fulfillment 
of the requirements for the degree of 


MASTER OF SCIENCE IN MANAGEMENT 
from the 


NAVAL POSTGRADUATE SCHOOL 
June 1998 





fl TF 6 ie 
DUDLEY KNOX LIBRARY 


PHS 7 ¢ 
wi 4 S. 4i | 
wa AM e>¢ 
od & pe 


ABSTRACT - MONTEREY CA g3563.5,95 


This thesis supports the evaluation of standard classroom course conversion to 
distance learning alternatives for disseminating advanced education at the Naval 
Postgraduate School (NPS). Distance learning is widely used throughout business, military, 
and academic organizations. Distance learning is convenient and eanine significant interest 
and importance to military personnel in assignments which hinder standard classroom 
attendance. This study focused on developing methodologies that could properly support a 
cost comparison for conversion of standard classroom instruction to distance learning. This 
study involved personal interviews with both military and civilian professors and other 
academic experts in distance learning design and implementation as well as a review of the 
literature. This thesis recommends NPS conduct further research to design a data base to 
collect reliable and relevant cost data to support future cost studies. NPS should also 
compare equivalent existing distance learning courses for content currently offered at various 
institutions other than NPS for consideration as possible substitutes for NPS classroom 


instruction. 


- ee 


KOOL 





IT. 


ITI. 


TABLE OF CONTENTS 


INS plots (C0) IS) POCO) peers... cscccscessscacesocssiassacsdecees cs-ceoetemees fut. coctaMieMbuecdtcacuedacnsbeseseeds l 
A. ANS oO) 1 TO) ICIN poate et pee oe nbneenr rs 15... 0 eee 2 
B. BVI GIO) Beene enemy nN ec coe eee oes 3 
c: JERS EXONS) 6 cont ha yy no ere + 
D. BME SeenON LLOUING .....c0-cecccstccesscceeeesaccecea=cels teueee MER EEataace eee eee “ 
te SC] i ales ae Sanna a ey Rina Sala MER a3 4 
F. Jiyplle,] Bes KC) LoL) OG Ree eee ears teeter Nr reme rN iF 57 5 
G. (ORR SPN VAS LG nnn TS ee > 
PV OIN ES 2x GROTON rae occa eee eae Ea ceo sdevac sa soveessbueessterenes 7 
A. |S  U <i OUTING DONG (hepa A ole cee Ee a 
iL. Organizational Design «..2:.12.21. 1 .a eRe s <osasscssassascsbcetseeeuees 8 

De MASKS 2ocse 5 sess ee oo: 122 TR Si... csssseiisdsivecsssesasteeunrs 9 

By URAL Co yaa eee Pe on cc leSecdessenseceetscenston’ 10 

4. Future Trend and Decision Making Factors in the Big Scheme....11 

5, Governing Factors that Guide the ProcesSs..................::ssssseseseeeceeees 13 

a. BACK CLOUD are en... UME. <...senssssucensecssesszeveebarscrs 13 

b. Fe OCI) Oy eenn NNN een 099s cece ceca siaiseaseoesenaasdsedsecesedeceeessott= 14 

C. MOOG tavern cesta a2 donc ck sesibutaliscssevieielicesceleertiecies 14 

d. SOs Me clam VG UMM tec. «cs <c<.<.ssasuedecsca2eqcBeaccacoeesecee sts ik, 

e: MO Nett OLE. sae ccacees -..s-c<e-na02q0-andateeeyeeanaenae ee menee ceases 15 

DISTANCE LEARNING i anamannan. AI. ela occcce cee 17 
A. JSyVACC ING: COLAND) ce ae eg re rn ee 18 


IV 


I Facts about Distance Learning..................00000.. SV eneasteoreeteceace emer 19 


Z College Courses and the E-Niailees eee ee 20 
cy Other Statisties sv..cis.4teesoee ee ee 20 
4. Western Association of School Committee (WASC)........0000000000.. Zi 
B. IDE ARNT GY TS ieee eee des oa ee es JL 
Ih. FAN 6) 0) || e210) lire 84 (=e rs eee ee ae wep! 
Dy: WA OGLE YS si ic<cisnn8ssecGaceemate re scasee core ees cee te eeua ns ene es |e ee ee 23 
C. ELEMENTS OF DISTANCE LEARNING COURSE DESIGN .............. 24 
D. DEVELOPING OBJECTIVES, METHODS, AND EFFECTIVE- 
NES Sone sccccevesvesdccesossseetwadecveteccewcesencadssec2s eee Renee ee as oot eee sake NS 
L; ODJECUVES .222c20502055.05 eects hac ea cbse 25 
2 IMME INOGS ..i.csceh ee eceee, eo veree.cc) eI 3, Relea 25 
3 EPTECUIVENESS 2. scac 5.0 eco 85, «od bedi aav a heec es 25 
4 WHEASUTES OF EVAN AU OM: sos 55s .sn00ec-s0d004ten teeter «<< .0 00 tgseeeus<lscsayeceeaeaee 25 
EE SYSTEMS MANAGEMENT DEPARTMENT. .............::cccccccsssersecceeeeeeees 26 
l. SSUUGLS I ENING Vcd Utes tees nena renee ae eM noo cco asvaezecsiiddscseesss 27, 
2 PayRD Cale ee crore eee eee sols cdeccaceclessencenaacnces 28 
3). section Curmiculum IWhatwisaerrceeiee.-....2<c22cocccc-2-coecszasceseseeeeeceetes 28 
4. @ourse Spreadsheet Wiatrax ermmenemetee 1 o.00505-2éssrceesceeedececuesevess eee Zo 
Jel. COURSE SELECTION ‘CRY PE IMA errrette <<. ccpehececasees coscevcsusesisncetans coves 31 
G. ANTICIPATED BENEFIT PS#5INID SU IV IVER MIO. 5. 5020202. < 0542 -020ce0eceoaee onotedee- i) 
METHODOLOGY ., Fert os... eR Soo cncenoanban cansusessaasescesaessueunsess Si 
A. COURSE CONVERSION CRITE RUA. 2S rei cec- 2-2 35 
B. ADVANTAGES AND DISADVANTAGES ............-ccscccecscsersssssssssseeees 36 


Vill 


l. W OM ULC <2 Seer as oc SURES... ccsvsndescoonces me oc oo See ee 37 


Ze KET ASST MMM NS WAN LOM. c.2502025...-.s0cde0ss cdnvdecstuece eeeee peneameet A << se 00eeas 37 

3. COMES PENAeMCe COULSES ©, 6... ......cenccorssbcs-se sess eens oto 37 

©: DYE Grea SIRO GE, eh cecig See eee eee eT rr os ee 37 

le Expense Categories and Related Variables... eeeeeeeeeeeee ees 38 

Dy, Siete ritel (Crops! Vata 2 LS 5 Ener TE 39 

3 IWiaroitract ln © StI atl al le sya soes ces occ. .scceaceseseececsouses soceacdesnss Ae 40 

4. COMM UO © OStay Arla leS | 5.222205. es 00<s0sd..<.s4200s009ensceas stceeeeeee eee 40 

a. Fommulasilised tor By alation ......-...-..ss.0.ssesscsssteoss semana 40 

By Comparison Cost from Outside Sources.................cceseeeees 4] 

c Coston Course Conversion Quotes.......::..5:-..c..:.-.secce.sseeeee 42 

V. COIS TIS SEN IIE EIN WANG Bay G0) (sie ns rae 43 
A. NS) Ub Ne?) FCG AES apace aasceccciacecce a5 as See ee ee eer 43 

B. SO SiC IVER Aas INS Ay TINGS ooo ceo soe och en oncd sda 200s c4 cc esecdeedeccasecadaecee 43 

C. eet SAN URGING IMBC lc ON IMC CI Es) eae ie ei ene eer nS 43 

ie (Clore eta Elo) (59 eltoh qs) re 21010) 9 | eee ee gery 44 

D. SON GI WSIOINIOR AINA MEN SUS cece. 5c. -.2soccds.sseccsssesneceseseceeesssseeee ee “4 

VI CONGCEUSIONAIND RE CONMMIBINDAMMONS 22.225. svecccssscicssededccchertocedeecsereetee 45 
APPENDIX A. GOSS uae eons cine eesedoscaicanascuendelaes eau Seauesseueecee 47 
APPENDIX B. EDUCATIONAL SKILL REQUIREMENTS... eee eeeees SY 
APPENDIX C. COST PER CURRICULUM MODELS (VARIABLES).............. 63 


Table 2.1. 


Table 2.2. 


Table 2.3. 


Table 2.4. 


Table 2.5. 


Table 2.6. 


Table 2.7. 


Table 2.8. 


Table 2.9. 


Table 2.10. 


LIST OF TABLES 


OOS) SCLIN ES 2S RC coer ne a eee 25 
IW eXs 0108 Si os eee ee meen ten, ieee Cee 25 
| SECTOR Css Ny ae 25 
SS UCL MIMENCAPM GVA ATEX o2051 2025.4 0.duesacereteeessnssenecnsacecdeles steeevensassssdhant Metretntete: 7 
NAW SW cll CR eter nes, oo cccc ses nsacvertncrsear astttecsdiecssesnsreese-e sete oatoeeee oe area nee 28 
Curricula Structure ...ccccccccsseccsssssscssssssccssssecssssessssuecsssueessssscssssssssssecsessivesese 28 
CCIE I ET 0°. a Re eg Dy) 
Gounses selecteditor Distance Leammine ver: sc17--<.....0..<...1s10ersss ere 32 
PRCA (ASS SIZE feet scccecscct 2.20122 tea oe «ac oe Rete vast ean eeee era ae eesae. 32 
PAVEraCe INMMMBED OF SLUCEMLS Mer OUaMCr sete. ..ccceee---. on ass 00levaesessssbecseese 33 


XI 





I. INTRODUCTION 


The transition from standard cai instruction to distance learning 
technologies could enhance military readiness capabilities. These technologies could 
result in cost containment or savings in a resource constrained environment. 
Implementation of distance learning technologies throughout the military could be an 
overall benefit toward retention and increased personnel morale. Providing continuous 
education opportunities could assist personnel in timely up to date knowledge and skills 
application through out their career advancement when the opportunity for attending full 
time school is not available. 

A driving factor for transition within the DoD is that advanced technology is 
targeted as the path to meet future military readiness capabilities. This requires 
considerable adaptation in instructional design, physical settings, administrative and 
technological support, production facilities and student/teacher preparations. (Reed, 
Loom) | 

Selecting and implementing the new technologies available for the virtual 
university of the future, in concept, is both intriguing and complex. This concept could 
generate a call for a system reengineering approach to the way higher education is 
developed and distributed. Imbedded in this process is the issue of decreasing resources 
and an increased need for highly technically proficient military personnel, the 
consequence of which may cause a serious dilemma for those responsible for 


implementing efficient or effective educational programs. 


This thesis will develop methodologies to design a comparative cost analysis 
process of education delivery systems. It will parallel the advantages and disadvantages 
of these methods in different learning environments and take into account individual 
learning styles, technology, time limitations, and constraints associated with the approach 
of the delivery. 

An additional factor of consequential value is the existing student accession P- 
coding process commonly referred to as the Quota system. This P-coding process 
establishes student accession limits, based of congressional resource constraints and total 
end strength measures. This sets limits on the number of students that can flow through 
the fully funded education system at the Naval Postgraduate School. 

The intent of this thesis is to research the possibility of providing more 
educational opportunities to more personnel with greater efficiency and effectiveness. 
This research may result in defining education delivery options that could achieve overall 
financial savings, enhance military readiness levels, increase required technical 
proficiencies and defined learning outcomes; and maximize promotion opportunity. This 
goal will meet the future needs of a military readiness level subject to financial 


constraints more stringent than previously imposed. 


A. ASSUMPTIONS 
The underlying assumptions of this thesis are: 


° Graduate level education is essential for military readiness to achieve the 
technical skills, current knowledge, and retention values necessary. 


+ The Quota system is a limiting factor to both the accession process and as 
a measure of success. 


+ Education levels should increase if more learning distribution options are 
made available to potential students. 


+ Savings will be realized following transformation of some of the standard 
core curriculum courses to distance learning methods as a result of 
reaching more DoD personnel and decreasing the school tour residency 


period. 
+ Investing in DoD personnel will increase retention in the organization. 
+ The residency requirement for a student can be shortened, thus increasing 


productivity levels in the workforce, while simultaneously increasing the 
number of accessions. 


> Only direct costs that are effected by volume will be accounted for in the 
formula, because those are the only ones that will change as a result from 


decisions made. This is relevant in that direct variable and common fixed 
costs will remain regardless of distance learning methods implemented. 


B. BACKGROUND 

The NPS is faced with fulfilling the educational needs of the future military 
leaders of the United States in a continuously resource constrained environment. This is 
not a new issue and the mission to today's leaders is still as follows: "Leadership in 
today's rapidly changing Navy requires long range planning and effective use of all 
assets. As the downsizing and restructuring of our Navy evolves, all must take great care 
to safeguard the most treasured resource: people. The men and women who make up 
this force depend upon sound leadership to chart the way. All must commit to 
professionalism and be the example, guide those served and model the core values this 
nation was founded upon, showing dignity and respect to all. Continuous improvement 
must be the battle-cry. Command excellence and mission readiness can only be achieved 
through a constant dedication and commitment toward this cause. Training is essential to 


prepare effective leaders for the responsibilities they face." (Kihune, 1993) 


C: PURPOSE 

This thesis will attempt to illustrate a methodology for matching efficient 
educational delivery models to effective ae styles, and compare the relevant costs 
associated with each evaluation method. The cost variables when available could reflect 
a comparative retum on investment or payback period cost benefit. Once the appropriate 
data becomes available a comparative measure could be defined as a unit cost factor that 
could be directly related to each method. This may become one factor for choosing 
among courses that are best suited for converting to alternative distance learning models 


for use at the NPS. 


D. RESEARCH QUESTIONS 


IL. What variables are required to establish methodologies for cost benefit and 
cost analysis research of distance learning alternative application at NPS? 


wm Is there a cost comparison factor that is relevant and reliable for selecting 
a distance learning alternative? 


E. SCOPE 

This research will (1) address issues restricting individual personnel in attaining 
advanced degree education due to the existing quota systems and tour constrictions; (2) 
determine the advantages and disadvantages of implementing alternative learning 
methods into the Systems Management Curriculum: (3) identify courses that could be 
developed to parallel the learning environment and individual learning styles related to 


the technology applications. 


F. METHODOLOGY 

The research protocol includes the following steps: (1) defining the curriculum 
core similarities to establish a structure of comparability; (2) defining the parameters for 
selecting the best distance learning alternatives for selected core courses; and (3) 
determining how to compute a “direct unit cost to select criteria for course transition to 
distance learning. 


The following formulas could be used as the basis for a cost comparison: 


ROI 

Annual Savings/Average Investment = (%) 
Payback 

Total Investment/Annual Savings = (Time) 
Unit Cost 


Total Direct Cost/Student Course Hours = ($) 


This may establish the working model for evaluating a cost basis for other courses 
considered for conversion to alternative delivery methods. This data could also support 
decisions related to changes in the curriculum to meet requirements related to NPS 


budget constraints. 


G. ORGANIZATION 

This study consists of six chapters. Following the introduction and background 
found in Chapters I and II, Chapter III describes the process of developing alternative 
learning models, Chapter IV provides the detailed methodologies of how all costs could 
be calculated to compute a comparative analysis of one learning alternative to another 


provided appropriate data were available. This chapter further explains any underlying 
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assumptions, learning alternative advantages and disadvantages and limitations, 
associated with matching alternatives to learning environments. Chapter V is an example 


of cost data variables. Finally, Chapter VI provides conclusions and recommendations. 


Il. MISSION BACKGROUND 


A. ENVIRONMENT 

The organizational design of the Naval Postgraduate School (NPS) process is 
dynamic, intricate and uniquely complex. This observation is the context in which this 
thesis is based. To understand the complexity a brief explanation describing three 
components is provided. These components are the processes of financing, authority, and 
student accession. This will set the tone and transition into the issues to follow. 

The Naval Warrior must be adequately prepared to provide support, fight, win, 
and maintain daily operations in a multitude of situations. The task is to bring together 
the mission and the resources needed to achieve the output desired. 

Military Readiness is a measurable output developed through a designed strategy. 
Strategy is defined as the stream of decisions about how organizational resources will be 
configured to meet the demands, constraints, and opportunities within the context of the 
organization’s history. One perspective on this issue as stated is, “Measuring readiness is 
like nailing Jell-O to a wall.” The dilemma is that time and resources are out of balance 
so that the highest possible level of readiness for every unit can not be afforded at all 
times. It would seem that the answer is to find a way to calculate the cost of change in 
readiness. The answer is not always throwing more money at the issue but analyzing 
where, how, and when the money is spent. What analytical method would be most 
effective in assuring the validity of the readiness resource allocation equation? One 
approach 1s that at low-level units, readiness should be measured in units of time. For 
training, readiness measurement is inherently a scheduling problem. In higher level 
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units, readiness can and should be measured from a resource perspective; this calculation 
is inherently an assignment problem. Readiness can be measured rigorously, but in doing 
so, presents many analytical challenges even to professional researchers. (Raffensperge 
and Linus, 1997) 

Military readiness is established and maintained through effective leadership. 
This can only happen through programs derived from both academic and active duty 
force components. In support of attaining military readiness the NPS’s mission statement 
includes the phrase “to increase the combat effectiveness of the armed forces of the 
United States by providing quality education.” Current strategy involves the application 
of technology to acquire the effectiveness necessary to meet the needs of combat 
readiness for the future. This was the message given by the new superintendent at a 
Student Group Lecture. 

1. Organizational Design 

To help assist in understanding the nature of the design a crude Organizational 
Chart 1s provided. 

President of the United States 


Chief of Naval Operations (CNO) OP00 


Vice Chief of Naval Operations OP09 


N1:DCNO Manpower, Personnel and Training OP-01 
N7:Naval Education & Training Command 
N82: Fiscal Management Division 


NPS 





N82 functions are listed for clarity and understanding: 


4 


4 


¢ 


Ze 


Develops, reviews & executes Navy budget 

Translates program requirements into appropriation requirements 
Reports execution results to USD 

Requests allocation from FMO 

Justifies budget request to USD 


Task 


Meeting the mission at all levels requires looking into the organizations structural 


design and understanding each level of input toward the end product, the student. 


The Major Functions of the Military Departments, Under their respective 


Secretaries, are to: 
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Prepare forces and establish reserves of manpower, equipment, and 
supplies for the effective prosecution of war and military operations short 
of war and plan for the expansion of peacetime components to meet the 
needs of war; 


Maintain in readiness mobile reserve forces, properly organized, trained, 
and equipped for deployment in emergencies; 


Recruit, organize, train, and equip interoperable forces for assignment to 
unified and specified combatant commands; 


Prepare and submit budgets for their respective departments; 
Develop, house, supply, equip, and maintain bases and other installations 
and furnish administrative and logistic support for all forces and bases; 


and 


Assist each other in the accomplishment of their respective 
functions.(AFSC PUB 1,1993)1-10 


ay 


Strategy 


A monumental strategy is to fully embrace the integration of advanced technology 


throughout the Department of Defense as prescribed in the following guiding principles. 


The President of the United States mandates that it is an obligation to provide the 


best training for federal employees at the lowest possible cost. The following plan was 


set as the guideline to the National Economic Council, the Chief Information Officers 


Council, the Office of Personnel Management, and the Office of Science and 


Technology. 


¢ 


Make full use of best commercial practices when purchasing instructional 
software; 


Work with businesses, universities, and other appropriate entities to foster 
a competitive market for electronic instruction; 


Develop a model technical approach to facilitate electronic instruction 
building on existing agency efforts, such as the Advanced Distance 
Learning Initiative Partnership; 


Develop and support a program of research that will accelerate the 
development and adoption of new instructional technologies. (Clinton, 
1998) 


Admiral Boorda, as the Chief of Naval Operations, set forth the following 


standards regarding a level of commitment in support of graduate education: 


I reaffirm the investment in graduate education of selected officers to be a 
strategic requirement for the Navy. With today’s technological, 
managerial, political, and economic complexities, the need for graduate 
level expertise has never been greater. The educational development of 
officers in specific subspecialties greatly increases operational readiness 
and, as a corollary benefit, develops the intellectual diversity and capacity 
that enhances the total professional performance of our officer corps. Our 
investment in graduate education must be pursued as a priority even in the 
face of competing demands and declining resources. The NPS will remain 
Navy’s primary source of fully-funded graduate education. NPS will 
remain committed to the development of curricula that meet the highest 
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standards of excellence and the unique professional needs of the Navy and 
the Department of Defense (DoD). Subspecialties that do not require 
military-unique education will use civilian universities to provide graduate 
education to their officers. The Superintendent, NPS will administer the 
Navy’s fully funded graduate education curricula at other DOD graduate 
institutions and at civilian universities. N8 and NO9B will ensure NPS has 
the resources needed to offer excellent curricula. (Boorda,1994) 


4. Future Trend and Decision Making Factors in the Big Scheme 

Current trends in leadership and knowledge requirements are in strategy 
transformation at both the individual and organizational levels. 

Some of this transition will be through utilizing distance learning programs 
effectively. This can only be accomplished through critical design and cost analysis. In 
order for this to be meaningful and relevant a multitude of variable costing and quality 
factors should be provided in the decision criteria. 

Access to knowledge is the wave of future success. Knowledge is power when 
shared and coupled with the authority to utilize it appropriately for an organization’s 
effectiveness and efficiency. Access to the knowledge is what distance learning is all 
about. The goal is to provide the tools that support the outcome of a job well done. This 
principle may change teaching technology throughout the organization. 

The effective leader seeks balance in mission requirements and resource 
availability to maintain a status of comfort and equilibrium within the organization. An 
educated leader can recognize the need for change to bring about the balance and 
equilibrium to remain an effective/efficient organization. A look into the future of higher 
education and how it will effect the competitive edge in our educational facilities is based 


on cost effective and principled business decisions. 
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Mr. Conley in 1993 commented: the most striking observation one 
reaches about technology in education over the past dozen years is not its 
impact but its lack of impact. Informational technologies have been 
adapted into the central offices, but “technology has not revolutionized 
learning in the classroom, nor led to higher productivity in schools. While 
telecommunications may prove to be a powerful tool for restructuring, its 
use at this point is primarily to expand, not to change, the existing 
curriculum by offering courses such as Physics or French to schools not 
otherwise able to offer them and by employing traditional instruction 
strategies.” Certain technologies have definitely found niches in 
education, Smith and O’Day (1990) say that the technology of the last two 
decades has changed far less than it has the worlds of work, entertainment 
and communication. On the whole, they say, teachers have simply closed 
their classroom doors and gone right on teaching just as they were taught. 
(Portway, 1994) 


Mr. Thomas relates in his article: In the book, “Competing for the 
Future,” C. K. Prahalad and Gary Hamel suggest that major paradigm 
shifts in an industry never start with the leaders. Major change comes 
from the upstarts, the organizations who are willing and can afford to take 
risks. Thus far, corporate universities have been these risk takers, and 
have consequently moved to an innovator role in business education. As 
corporate universities adjust to market trends, capitalizing on their 
responsiveness, relevance, reach, resources and cost-effectiveness, it is 
imperative that other educational institutions, especially traditional 
business schools, particularly those not in Business Week’s top 25, 
become aware of this new competitor and re-think their position. Those 
who don’t may not be around for very long. (Thomas, 1997) 


An article in the magazine “Money and Management” supports economic 
concerns for the future of education in the following passages. 
Educational market forces make competition a concern for all higher 
education institutions. Within little more than five years, post secondary 
proprietary education has been transformed from a sleepy sector of the 
economy, best known for mom and pop trade schools, to a $3.5-billion-a- 
year-business that is increasing dominated by companies building regional 
and even national franchises. The incentives take on the “Instead of 
digging into tax coffers or mounting fund-raising campaigns, for-profit 
education companies turn to the stock market.” “The whole move to 
public ownership is an important move in higher education” because it 1s 
attracting capital talk, says Robert B. Knutson, chairman and chief 
executive officer of Education Management Corp., a Pittsburgh company 
that operates art institutes and culinary programs. As noted in the Wall 
Street Journal: Computer Learning Centers, based in Fairfax, Va., own 
and operator 17 computer-training schools, reported in November that its 
earnings for the most recent quarter were up 85 percent and it’s revenues 
i 


were up 52 percent. Legg Magon’s Mr. Soffin is recommending that 

investors buy the stock, on the basis that the company has found the 

“sweet spot” of the education market: information-technology training. 

(Strosnider, 1998) 

S) Governing Factors that Guide the Process 

The following data were gathered from the Officer Subspecialty System 
Handbook, 1997. The goal of the Subspecialty System and NPS education program is to 
provide sufficient officers with subspecialties for which current and projected valid billet 
requirements exist. Officers aierieg, under this program will receive graduate 
instruction essential for performance of duty in accordance with subspecialty competency 
requirements. A secondary objective of the program is to continue the education of all 
officers, and thereby, raise the technical and managerial competency of the officer corps. 

a. Background 

The Navy funds graduate education to meet subspecialty requirements to 
the fullest extent possible. Department of Defense monitors utilization of sub-specialists 
qualified through funded graduate education to ensure maximum return on investment 
and retention of these highly qualified officers. 

Due to the nature of the military and readiness contingencies a dynamic 
system for planing and executing force structure is essential. Currently this program uses 
three processes to manage and maintain this balance. The three processes are: P-Coding, 
Quota Plan, and the Naval Officer Subspecialty System. OPNAVINST 1000.16 series. 


Approved Subspecialty Codes are listed in the NAVPERS 15839. This process has been 


in place since 1975. 
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b. P-Coding 

A P-Code is a general suffix criteria that implies the position coded 
requires extensive knowledge of theories, principles, processes and/or techniques 
certified through the acquisition of the master’s degree for optimum performance of duty; 
also requires the conception, implementation, appraisal or management of complex Navy 
and /or DoD programs. 

Cc. Quota Plan 

The goal 1s to reach a steady state for all curricula, thus eliminating large 
fluctuations in student input and making the most efficient use of P-coded officers. The 
model is designed to assume that all quotas generated will be filled at the right time and 
that P-coded officers will be utilized at every opportunity. 

While the quota model identifies the ideal graduate education input for 
each subspecialty area to satisfy one hundred percent of requirements, the published 
quota plan typically reflects fact-of-life constraints imposed by officer shortages, 
operating tempos, among other things including fiscal and numerical constraints imposed 
by Congress, manning levels, availability of qualified volunteers, and so forth. The quota 
plan shows the actual input planned for the fiscal year in question. This plan is tracked 
quarterly. Overfill requests for stated quotas can be made by the detailers, the people 
responsible for matching personnel billet and assignment through PERS-440B. These 
requests will be evaluated by the Curricular Officer, Academic Associate, and 
Department/Group Chair to determine if space and faculty budget will accommodate the . 


request. 
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d. Subspecialty System 
The Naval Officer Subspecialty System is a professional development 
system in which requirements for specific professional qualifications are identified by the 
Chief of Naval Operations (CNO). The Deputy Chief of Naval Operations for 
Manpower, Personnel And Training (N1) identifies, develops, and assigns officers to 
meet these requirements. The Director of Naval Training (N7) provides the necessary 
education policy and has administrative responsibility for the Navy’s fully-funded 
education programs in support of the subspecialty system. The Assistant Vice Chief of 
Naval Operations (NO9B) provides the necessary education resources. This system is in 
accordance with OPNAVININST 1000.16. 
é. Utilization 
(1) Requirements. Utilization of fully funded graduate 
education is a critical part of the officer subspecialty system and requires careful 
management for return on investment and retention. 
The DoD Policy on Graduate Education for Military Officers is 

DoD Directive 1322.10 and dictates as follows: 

e Considers all officers who possess a graduate degree and grade required 
for assignment to a validated position as available for assignment to that 
position. 

e Requires that officers who receive fully or partially funded graduate 
education serve in a validated position (requiring that education) as soon 
as practicable after completion of the education, but not later than the 
second assignment following completion of that education. 

e Ensures that each officer holding a graduate degree serve in as many 


positions appropriate to that degree as Military Service requirements and 
career development permit. 


is 


“ Requires that the minimum active duty obligation for officers who have 
received fully funded or partially funded graduate education shall be a 
period equal to three times the number of months of such education 
completed during the first year of graduate school and one month for each 
month there after unless a different period of time is prescribe by Law 


(2) Study Results. A NPS utilization rates study provided by 
the Center for Naval Analysis in January 1998 revealed: 


For officers who earned their P-Code in years 1984 through 1989, we 
looked at the percentage who served in a utilization tour that matched their 
program of study exactly, as well as the percentage of officers who 
fulfilled their obligation by serving in a ‘closely related’ billet, or some 
other billet that qualified as a payback tour. 


Beginning with the restricted line, we found that slightly more than half of 
officers (54 percent) filled a billet with and exactly matching subspecialty 
code, while 91 percent filled some type of qualifying payback tour. 
Slightly less than half of the officers that filled an exactly matching billet 
(25 percent of all P-coded officers from the restricted line) were assigned 
to it within a year of earning their P-code. Two thirds of officers that 
filled and exactly matching billet (36 percent of all P-coded officers from 
the restricted line) were assigned within 3 years. The remaining third took 
more than 3 years to go to this assignment. 


Utilization statistics are substantially worse for officers from the 
unrestricted line. Only 30 percent of officers who earned their P-code in 
years 1984-89 had been assigned to a tour of duty in a matching 
subspecialty billet by the fall of 1994, although two-thirds had filled some 
type of utilization tour at that point. Among officers who did fill a billet 
that exactly matched their subspecialty, only 19 percent did so 
immediately (6 percent of all P-coded officers), and about half did so 
within 3 years. The utilization rate in exactly matching billets is important 
because the Navy spends considerable resources in tailoring curricula to 
the education skill requirements (ESRs) for specific jobs. Time utilization 
is crucial in support of the ESRs for emphasize applications to current 
Navy problems and use of current Navy systems. Delays between 
education and utilization dampen the effectiveness of these applications 
because the currency of information is lost and the amount of information 
that is retained declines. (Caavalluzzo and Cymrot,1998) 
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UI. DISTANCE LEARNING 


A series of independent articles reported in the Navy Times indicates support of 
education and distance learning programs. CAPT L. Wilson, the Navy’s top officer- 
strength planner addresses balance in end strength. He comments that Navy commissions 
are increasing due to downsizing effects as the top end retires and the numbers at the 
bottom aren’t balancing the losses. This will happen via the NROTC and OCS. One fifth 
of the commissions are from the fleet. The Navy would rather keep it’s expensively 
trained officers than recruit new ones. “Retention is really the No. 1 priority, because 
we’ve invested the time and money,” said LCDR Lydia Robertson, a personnel bureau 
spokesman. “We work with the accessions to build up behind that.” (Peniston,1998) 

The article titled, “Study says smart money is on education,” states “scholarly 
sailors are more likely to stay, advance.” Paul Plawin of the American Vocational 
Association says, “You retain quality employees by offering career-enhancing 
education.” “Instead of looking to move on, a common problem in industry today, they’re 
looking to move up.” (Burlage,1998) 

Navy LCDR Franchetti, a career Naval officer is one of the seven million 
students, according to Pam Dixon, author of Virtual College, achieving success through 
distance learning programs. LCDR Franchetti comments, “It’s no secret that barriers 
exist for military members interested in obtaining education. Long work hours, frequent 
travel, and repeated relocation are some examples.” Now I no longer have to worry 
about changing duty stations before I finish my degree, or losing time, credits and money 


on courses that won’t transfer to another school.” Distance learning is growing. In 1993 
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only 100 accredited institutions verses 750 in 1998 were listed in references in North 
America. (MrBride,1997) 

The evaluation of training is paramount to meeting corporate goals. Evaluation of 
all training is crucial to supporting the notion that training is a key component to 


company success. (Crum,1995) 


A. BACKGROUND 

The following data was gathered from the Distance Learning Resource Handbook 
from the Air Force Distance Learning Office (1997). A brief history of the concept of 
distance learning indicates the impact this technology has had on educational delivery 
options. This review suggests that there are many factors to be considered and desired in 
using this approach to support the educational process. Following this analysis some 
general facts are given to emphasize the importance of this undertaking. For a point of 
reference and clarity of terminology a “Glossary of Terms” is found in Appendix A. 

Distance learning is more than 200 years old. In fact, the Boston Gazette ran ads 
for shorthand lessons by mail in 1728. Australia’s University of Queensland offered an 
external degree program in the 1890’s. Columbia University offered extension programs 
in the 1920s while other schools began using radio to disseminate education in the 1930s. 

Distance Learning has been a normal part of education and training programs for 
many years. Using paper-based media, a variety of programs from career development 
courses to Professional Military Education correspondence courses have met varied 
education and training needs. The Air Force, for example, in 1950 founded a 
correspondence school, the Extension Course Institute that supports formal training and 


educational programs for the Air Force, Air National Guard and Air Force Reserves. 
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Since then, operations training, professional military education and continuing education 


courses are using floppy diskettes, videos, CD-ROMs, interactive satellite broadcasts, 


video teletraining seminars, the World Wide Web and other media to deliver education 


and training courses worldwide. 


Distance learning is the acquisition of knowledge and skills through 
extended information and instruction, encompassing all technologies and 
other forms of learning, wherein a time and/or physical distance between 
student and instructor exists. (Kimberly, 1996) 


Open Learning is a PHILOSOPHY-one of giving learners more access to 
learning and more choice and control over what and how they learn. 
Sometimes this means merely that learners are able to choose the time, 
place and pace of their learning. But it can extend to opening the learning 
to new kinds of learners (e.g., less qualified or wealthy ones) and/or giving 
them choice about what and how and with whom they learn. It may or 
may not involve distance learning. Distant Learning/Education is a 
TECHNOLOGY—one that enables learners to learn without being in the 
same place as their teacher, e.g., with the aid of self-teaching materials 
(like specially prepared workbooks, textbooks, multimedia packages), 
WWW material, resources available in community or workplace, 
conferencing and, correspondence with a supportive distant tutor. It may 
be no more open than conventional courses. (Dr. Derek Rwontree, 
Professor of Educational Development, The Open University). 


1. 


Facts about Distance Learning 


A U.S. Department of Education Study on Distance Education in Higher 


Education reports the following: 


58% of all higher education institutions offered or planned to offer 
distance education courses; 


An estimated 25,730 DE courses with 753,640 students enrolled were 
offered in the academic year 1994-95; 


An estimated 690 degree programs and 170 certificates were offered 
exclusively at a distance; 


Three-fourths of the institutions developed their own course curricula; one 
third purchased courses from vendors; 
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Types of technologies used include: 

Two-way interactive video (57%) 

Two-way audio with one-way video (24%) 

One-way pre-recorded video (57%) 

Internet and other computer-based technology (36%) 

The most common technologies to be pursued during the next three years 


were two-way interactive video and online/computer-based, as identified 
by three-quarters of the institutions. 


The four most important reasons for offering distance education courses: 


Il. 


4, 


as 


Increase student access by making courses available at convenient location 
(82%). 


Increase access to institutions by new audiences (64%). 


Increase student access by reducing time constraints for course completion 
(63%). 


Increase institution enrollments (54%). 


College Courses and the E-Mail 


The annual Campus Computing Project survey shows that nearly 33% of courses 


offered at the 605 institutions polled use e-mail, up from 25% in 1993 and 8% in 1994. 


At private universities, the percentage of courses using e-mail is 60 percent and nearly 


half of public university courses use it. More than 14 percent of all institutions put class 


materials, such as syllabi, on the Web and more than 24% use other Web resources, such 


as online encyclopedias. (Chronicle of Higher Education, 17 Oct 97) 
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Other Statistics 


In 1995, more students enrolled in distance education courses than entered 
all the US colleges and universities as freshmen. (ED, Education at a 
Distance, March 1997). 
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2 More of the $50 billion spent annually on employee education is going 
into distance education (Home Education Network, 1997). 


” Demand for technology-based training will rise 10% a year to $12 billion 
in 1998 (Gartner Group,1997). 


e By the year 2000 half of all corporate training will be delivered via 
technology (Quality Dynamics Inc, 1995). 


e Web based IT training will grow from $92 million in 1996 to $1.7 billion 
in 2000, with an emphasis on Intranet-based, asynchronous, self paced 
instruction (9/8/97 Web Week). 

‘ John Bear says that his Guide to Earning College Degrees 
Nontraditionally now lists 87 properly accredited American colleges and 
universities with degrees 100 % by distance learning, and 117 with very 
short residency requirements (4 weeks or less). And, his update site on the 
web lists 20 more new degree programs. See http://www.degree.net. 


. About 48% of companies with more than 100 employees are using 
computer-based training. (Training Magazine 1995 Industry Report). 


4. Western Association of School Committee (WASC) 

As part of the WASC preliminary report, NPS has documented the progress taken 
to enhance its position concerning distance learning implementation and application 
strategies in order to decrease the costs of graduate education of naval officers. 
Specifically, rethinking the issues of officer military education and training in Joint 
Professional Military Education (JPME) 

NPS has entered into the distance learning era as evidenced by many classrooms 
equipped for VTC, and utilization of these classrooms having increased by 81% over the 
past year in the Aeronautics and Astronautics, Computer Science, Electrical and 
Computer Engineering and Systems Management. Defense Resources Management 
Institute (DRMI) and NPS are interactive via VTC. Most areas of the school are Internet 


accessible. Many software packages have been purchased to enhance student access to 
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information and have been placed in the Computer Learning: Resource Centers. 
Currently, interactive computer programs are being evaluated for use in the math 
departments and have achieved a positive student response. The Institute for Defense 
Education and Evaluation (IDEA) is proposing partnerships with the private and public 
sector to further develop and distribute education on the Internet. IDEA is also 
coordinating the development of DL courseware products in support of its Executive 
Management Education (EME) program for BUMED. The library is working on 
accessing electronic resource material to complete the online data available for a more 
complete reference library. Overall NPS is moving to integrate distance learning 
technologies into its graduate curricula and is collaborating with organizations also 
seeking to establish distance learning committees and capabilities to meet the military 


graduated education requirements of the future. 


B. LEARNING STYLES 

Every one has a different approach to learning. Given this fact it is ideal to 
choose to teach to a learning style. The learner needs to understand his or her personal 
style of learning. The information about these styles is paraphrased from the book: 
Becoming a Master Student Eighth Ed. by David Ellis, 1997. 

1. Application Styles 


a Diverging: The learner considers a situation from different points of view 
and determines why it is important to learn a new concept, strategy, idea, 
technique, or method. 


‘ Assimilating: The learner absorbs the information provided to achieve a 
complete understanding. The learner is interested in knowing what 
strategies, ideas, techniques, or methods are important. The value is in 
learning lots of facts and then arranging these facts in a logical and 
concise manner. 
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e Converging: The learner takes the information gathered and tests it to see 
if it works. The learner questions if what was learned makes sense? Can 
the information improve the current situation? This style is concerned 
with how the strategy, idea, technique or method works. It is important to 
be able to apply the new information to a practical model. 


e Accommodating: The learner takes what is practiced and finds other uses 
for it. The learner asks where else does this apply? 


De Models 


le Concrete Experience (feeling): Learning that is a result of the learner 


feeling like the things learned are important and relevant to today. 


Z Reflective Observation (watching): Learning that is a result of watching 
others planing things out and taking time to make sure that what is learned 


is accurate. 


S. Abstract Conceptualization (thinking): Learning that results in 


familiarization with ideas, facts and figures and thinking about many 
concepts and lots of information on a new topic. 


4. Active Experimentation (doing): Learning that applies new techniques 
to ideas, trial and error, and “hands on” practice. 


For clarity an example of a learning cycle and learning style is presented: 
Learning to bungee jump. Perhaps you’ve experienced bungee jumping yourself or 
watched someone else do it. Many people prefer to watch this activity rather than 
participate. They witness a bungee jump and come to a conclusion: “This is one thing 
that I don’t need to learn!” If this is true for you, then your learning ends with Stage 1 
Activist (Having an experience). You choose not to gather information as in Stage 2 
Reflector (Reviewing the experience). For example, you don’t climb up onto a platform, 
look over the edge, or ask how to put on ankle straps. Other people might proceed 
through Stage 2. Some of these people decide they have learned enough and choose not 
to take the plunge. However, others might decide to make the jump, moving on to action 
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and practice stage 3, Theorist (Concluding from the experience). -When these people 





jump, they will automatically integrate the experience with what they know about bungee 
jumping. And if they decide to jump again, they might even add some new movement or 
flair to their jump. In short, they will move through Stage 4 Pragmatist (Planning the 
next step)of the learning cycle. These people can truly say of themselves, “I’m a bungee 


jumper.” 


G: ELEMENTS OF DISTANCE LEARNING COURSE DESIGN 

Criteria are needed when making a choice of which educational delivery process 
best suits the need of the student. Asking the nght questions will make all the difference 
in making the correct selection of course design. Particular emphasis should be placed on 
course design. Congruent with one focus of this thesis, one must consider working from 
two ends of a continuum or spectrum of environment dynamic. A reminder from Chapter 
I is that one end of the spectrum is an environment where learners have access to high 
technology learning environments and adequate time to participate in attaining higher 
education goals. At the other end of the spectrum some technology is available but time 
limitations interfere with obtaining higher education with any consistency. Please note 
that these variables are at the extremes and only used to stress the point that we have to 
look at both to apply learning methods appropriate to both needs. Keep in mind the idea 
is to extend educational alternatives consistent with the educational needs of career 
military officers and others that must stay knowledgeable, highly skilled and competitive 


for promotion. 
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D. DEVELOPING OBJECTIVES, METHODS, AND EFFECTIVENES 

Measures of evaluations must focus on the learning objectives, methods and 
effectiveness criteria desired to meet — expected results. See Appendix B for ESR 
descriptions. The development of the methods: 


1. Objectives 


(Knowledge acquisition ~—~—__ | Changing attitudes > ] 
Problem-solving skills Interpersonal skills | 
eee Ric wlndge reention | 


Table 2.1. Objectives 









2: Methods 





| Correspondence Courses Correspondence Courses |CaseStudies i t—i(i‘CSs*@zr 







| Conference discussion method Lecture with questions 
Business games ——S—S——~*d MooviesTfil 


| Programmed instruction Role playing/skill | Sensitivity training/T-groups 
| practices 


| Television lecture Computer based 





Table 2.2. Methods 


3. Effectiveness 






Training objective é | Most effective method Least effective method 


[Knowledge acquisition | Conference method | Television lecture 
[Changing attitudes | Sensitivity training | Television lecture 
[Problem-solving skills | Case study | Movie films 
Television lecture 
Programmed instruction. 
Sensitivity Training 


| 











—— 





{ 
: 
—_— 


Table 2.3 Effectiveness 
4. Measures of Evaluation 
Ninety-five percent of the time required to set up training should be design and 


only five percent delivery and packaging. (Doerr,1994) 


Zs 


Measuring the value of training is possible. How to use statistics and bottom-line 


budgets effectively can eliminate a plethora of obfuscation commonly used to avoid 


evaluating training. (Fitz-Enz, Jac,1994) 


To following is a step-by-step list of measurable criteria to consider in 


establishing an effective training program. 


Are the program learning objectives consistent with internal objectives? 
Is the recommended length of the program consistent with internal plans? 
Are evaluation procedures designed into the program? 

Does the content match the requirements from the needs analysis? 

Is the method of presentation compatible with existing practices? 


Does the program design require participants to be actively involved in the 
learning process? 


Are the program materials suitable for the target audience? 

Are there procedures/methods to ensure the transfer of training to the job? 
Can the program be used without modification? 

Does the program allow for skill practices? 

Are supporting material available for the participation’s supervisors? 


Is the program attractively packaged? (Phillips,1983, pp. 59and 220) 


E. SYSTEMS MANAGEMENT DEPARTMENT 


The Systems Management Department offers courses in 12 different fields of 


study. 


Currently, employing traditional classroom delivery, theses courses can be 


completed in 6 to 8 quarters (12 weeks/quarter). Many of the same courses (core 


courses) are required in each area of study. 
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The evaluation and comparison of the average student classroom size, average 
pay-grade of student, and length of time away from work assignments of students 
attending these courses are some of the cost variables relevant to establishing both 
savings and cost per course unit delivered. Cost per course unit could be used as a key 
variable in establishing resource efficiency criteria for course justification for transition 
to distance learning platforms. In order to adequately portray a savings many factors 
have to be considered. The following information is representative of a few of the 
variables. Note that changes with each class would have to be traced as a measure of 
impact on justified savings. 

1. Student Rank Matrix 


For the purpose of showing the range of pay grades and military services 


distributed within Systems Management Department, Table 2.4 is provided for reference. 


Service Grade | Grade | Grade | Grade | Grade | Grade > [al 
01 O2- es ee — 06 





Table 2.4. Student Rank Matrix 


Ai 


Me Pay Scale 


To assist in developing the potential savings of using distance learning versus 
traditional classroom a base pay scale is provided in Table 2.5. The pay is shown in 
rounded dollars of pay per month. 


Years of Service 


10 | 12 18 20 W/O BAS | 


155 
ase fsto9| S247 [S365 3546 [S7OT | SBOE | SBOE | SBOE 
aE 


Table 2.5. Pay Scale 





3: Section Curriculum Matrix 
The following table provides data about Quotas, P-Codes, and the number of 


students currently enrolled in each of the 12 sections within the System Management 


Department as of May 1998. 


Students 
| MV 813 Transportation 1304P NAVSUP 
pr ee vere 
| eee ee 
MR 815 Acquisition & 1306P- ASN/RDA i 38 
reer fee et tee 
hal , 7 Acquisition _ a oa —_ o 
sis 7 Defense mall 
Systems 
_ Analysis 


Table 2.6. Curricula Structure 







PR 
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Students _ 
MK 818 ~ Defense None > ~ VARIC | 
Systems 

MI 819 Systems 1303P NAVSUP 
pe Se | [aor 
ML 820 Internal None DSAA 
ces a [pf 
MM 827 Logistics XX32P NAVAIR 12 
pser—|-tase far} arto 

MF 837 Financial XX31P N-82 
oa ae. 
1MP 847 =| Manpower | XX33P | 7 ~~ | PERS2- | 
MD 856 Leadership and | XX38P 4 
fe fe ee et 
‘| 877 Shore 34P 

[ insatision | | 


PM aii Information XX89P <a 
oe 


[TOTALS asf a 



















Table 2.6 ye 


For clarity of the 12 areas of study and the similarities of courses required for a 
graduate degree Table 2.7 is provided. The table depicts some of the more commonly 
taken courses. This table serves as a means of identifying which courses are taken by the 
majority of the students in all sections within the Systems Management Department. See 
Appendix B Educational Source Requirements (ESR) for a description of the courses by 
title and content. 


4. Course Spreadsheet Matrix 


Cn la A Ra dB 2 


[AATTID —————— ————— ee ee = 


Kes 5d lV 
PMNOOST | | XT XT XT XT XT XX XTX | XX 
(MN215000 | | XTX |X| XTX | xX | xX | xX] xX | XX | 
PMN2300 Px x x x x x x x ee 
Sg aa ea ae a ae a ae | 


Table 2.7. Courses Matrix 
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| SECTION | 370 $15 $17 | 818 820 | 827 | 837 | 847 
poem [Ta [oe ef |e 
PCoURSEF ||| | re | 
ue =, 
PMN3I0S | xX |x |x ]x)|xi|xi{x{[x);x{x] | 
PMNs {|_| ||| | | |x] | 
PMNII40._[ || x |x ]x [x [xX |[x]>x|[x[x]x 
PMNBISG@ | xX |X |x] ~x{~x} ~x{] [x pPxyx 
PMNIGI_[ [|X |x |X [xX ]xX|]x|x|]x [x >x |x 
penta PX XXX x XX 
PMN3301__- || dX xXj= |e =| | 
PMIN3303__| an oe 
PMN3304 | 


penasi2 


| re ee ee 

PMNaios__| |x |x ]|x]x][x]x ,x ;x][x|x]|x] 
a DS SS OS 
lc A as i ld I a a 
| oe 
UN ee ee ee ee ae ee ee ee ee ae 
el ae el Bll 
NC) a a el ee 
Panates J} et 
ee a 


Lic baa rs ll 

Na Ree PS eS we. 
Hsoiz3 | XT XE XT XT XT XT xX | xX | xX] xX |X | 
WS3183 0 TE XTX | XT XxX | XT XT XTX | XX | XL 
}OS3006 | dE XT XTX |X | XTX | XTX | XY xX | XY 
rossioi_{ | Xx |x |x| |x |x, [| |x|x]|x, 
posses] tf x ff fT ft 
ES seal SS ee 


Table 2.7 (Continued) 


30 


F. COURSE SELECTION CRITERIA 

Table 2.8 lists the courses most commonly taken within the Systems Management 
Department. These courses could be considered for distance learning alternatives based 
on the following assumptions: 

+ To allow students to complete the core courses prior to attending NPS. 


This is an issue for some students that are assigned to billets within 
commands that can not afford to let a staff member attend a full time 


school; 
4 To shorten the number of quarters required to complete a Masters degree; 
% The course is essential to military readiness enhancement; and 
* To reduce costs and time associated with course completion through 


existing education systems. 

Additionally, there is additional criteria that must be considered for course 
selection and conversion. The distance learning alternatives should meet the same high 
standards and quality of classroom instruction, standard ESR objectives can be paralleled, 
all individual learning styles can be applied, time limitations addressed, and command 
technology and resource constraints considered. 

Another critical factor to be considered in this transition process toward distance 
learning instruction methods is the command performance indicator of excellence. 


Currently noted in the GAO/GGD/AIMD-10.1.1.8 Congressional Review of Performance 


Plans as: 
+ Defining Expected Performance. 
% Connecting Mission, Goals, and Activities. 
4 Recognizing Crosscutting Efforts. 
+ Connecting Strategies to Results. 


Sl 


4 Connecting Resources to Strategies. 

” Verifying and Validating Performance. 

+ Recognizing Data Limitations. 

Conversion Courses Matrix 

This matrix shows the courses that are taken by all Systems Management students 


and could be evaluated for conversion. 


io) 
= 
o4) 
io 3) 
pod 
~] 


[Section 370 813 
MN2031 
| MN2150 
| MA2300 
| MN3140 


| MN3161 

| MN3172 

| MN3333 
OS3006 

| NS3252 x 


dd 4 >d Dd Dd Dd Dd Dt oS 
bd dd dd dd Od Od Od OS 
Dd dd dd Od DE DL Dd Od > BD 
D4 dd dd dd Dd OR 

ioe) 
dd dd dd Dd Dd Dd Dd DE DEW 





PS PS PP OM Oe OM OM OS 
PS PK PK PS Pe PS OS OO 
Pe PK PM PK PS PM OM OOM 


1 + *&*§ © &€ & H HF HF F 
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Table 2.8. Courses Selected for Distance learning 
The average number of students for the courses defined for evaluation 1s depicted 
in (Table 2.9) to follow. This data could be used as part of the cost analysis computation 
in a Weighted average structure. 
Total Students per Quarter/Sessions Average/Number of Quarters 


This table depicts the average size of class enrollment. 


aaa oa ao 
peacoat tet tet tet tat teste 
pee) a 
mnsioi{26{ [22] | 31] fai || 3s] [29 | iva | 35 | 
pmn3172| 22 | 20 | 16 | 21 | 24 | 27 | 27 | 22 | 20 | 30 | 29 | ase | 23 
Metta ae cheats eS 
| ns3252 | 19 | 22 | 19 | 24 | 20 | 19 | 13 | 20 | 25 | 20 | a | ism | 9 


Table 2.9. Average Class Size 
32 











Total Students/Number of Quarter Average 


ae 96/1 | 96/2 | 96/3 | 96/4 | 97/1 | 97/2 |97/3| 97/4 | 98/1 | 98/2 | 98/3 | 
ene {ee 


IvIN2031 1 ial 


——, 


z 





[saa] [372] | rors |e] 34 | 21 
ete Sa i a 
eee ee es ae 24 | 
Mnsiaoios4| [412] ural |sora|_ 93a] | sea} 432 | 43 
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Table 2.10. Average Number of Students per Quarter 

























G ANTICIPATED BENEFITS AND SUMMARY 
According to the research report to the Health Care Committee Executive Board 
conducted by the Distance Learning Subcommittee the following benefits apply to 


distance learning alternatives: (July,1997). 


@ Reduces time away from the workplace; 

@ Increases access to utilization of satellite and other electronic delivery; 

9 Provides capability to train deployed and afloat units while underway; 

e Allows for improved Total Force training integration; 

° Allows for standardized training and focus on learning outcomes; 

° Maximizes utilization and sharing of quality instructors, thus potentially 


reducing instructor personnel requirements; 


@ . Provides a student-driven, learner-centric approach to educational 
delivery; 
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Increases the number of students entering into the graduate education 
program through increasing the number of annual graduates; 


Expands the scope of the market by providing accredited courses to off- 
site locations so that individuals can start on an advanced degree in route 
to an accredited institution; 


Provides continuous education accredited courses for people who don’t 
have time to leave the work place but need to stay current in their field of 
expertise, thereby accommodating some to the PME requirements for joint 
military education. Maximizes utilization an sharing of quality 
instructors, thus potentially reducing instructor personnel requirements; 


A method to decrease the time individuals are out of the productive work 
force. 
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IV. METHODOLOGY 


This chapter provides a detailed set of methodologies of how cost could be 
calculated to obtain a comparison of the various learning alternatives provided the 
availability of data was relevant and reliable to fit the methodology. 

Two methods of evaluation are cost efficiency and learning effectiveness. Cost 
efficiency can be evaluated via several formulas, 1.e.: Unit cost, Payback Period, Return 
on Investment and Unit Contribution. Each of these methods relies on the ability to 
gather reliable and relevant data. Learning effectiveness is based on the resulting 
outcomes and outputs established from the standardized organization objectives. Overall 
effectiveness is achieved when learning style, method and environment match in a cost 
efficient manner. 

Each of the costing methods and alternative learning methods have advantages 
and disadvantages due to technology, environmental limitations, time constraints, a 


students knowledge and skill level, as well as individual learning style. 


ye COURSE CONVERSION CRITERIA 

Course content and the analysis complexity of deriving and relaying the answer 
set the parameters for which method 1s best suited for DL application. Knowledge 
derived and relayed through material that is read followed by fill in the blank, multiple 
choice, mix and match, short essay type answers matches each of the three assessed 
course conversion methods, due to simplicity. Classroom instruction is the best method, 
as the complexity of content comprehension, analysis, and ability to derive, display, and 
answer increase, and where the need for interaction with a subject matter expert is 


required. This method, coupled with advanced computer technology support, work well 
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for extremely time consuming, mathematically intensive, multiple step answers, such as 
linear and multivariate regression analysis. 

- Computer based learning works well when course objectives are standardized and 
the answers are specific, or the answer applied is derived through formulas pre set in the 
computer. The complexity of the program is based on the nature of the learning 
objective. 

Critical impact on output is reflected in the match of student learning style to 
technology, the environment, time and resources available. What type of student is best 
suited for DL? One that is self disciplined and motivated. Who chooses DL? One survey 
says ‘Convenience’ is the single most cited factor influencing a student’s decision to 
choose to learn at a distance. (International Foundation of Employee Benefits Plans, . 
1897) 

The issue of cost efficiency for NBL course development cost is directly related 
to the capabilities for providing text, sound bytes, and streaming video. The richer the 
presentation, the more costly. For example a course with only plain text would have 
minimal developmental costs, but the experience would be similar to reading a book. 
Adding sound bytes could improve the presentation and at the same time add costs of up 
to $100/minute of sound. To have both the visual and sound in a streaming video, cost 


could increase to $1,500/minute (Lamar, 1997). 


B. ADVANTAGES AND DISADVANTAGES 
Advantages and disadvantages of any method of teaching is reflected in the 
results from the student. The more interaction between the student and the material being 


presented usually results in the best learning outcome. Direct application of the material 
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presented to a specific measurable learning objective is desired as the degree of 
effectiveness. 
1. Computer 
Advantages: Results are immediate. Time and place are independent. Learner 
Centric student driven. Time is at the disposal of the user, provided the 
equipment is available it can be utilized in all environments. 
Disadvantages: The student has limited interaction with the instructor. The 
student has to have or acquire skills and knowledge to use the software and have 
access to a computer with modem to access the Internet. Costly to develop, not 
always accessible due to limited technology. 
4p Classroom Instruction 
Advantages: There can be a direct relationship with the instructor. Instructor as 
the subject matter expert can assess the knowledge and skill level of each student 
and assist as needed directly. The full time student can concentrate on learning. 
Disadvantages: The organization may not be able to allow the student the 
opportunity to attend full time instruction in which case the student must fit the 
schedule of the school and the command. 


3. Correspondence Courses 


Advantages: Reading and comprehension skills are all that is required. These 
courses can be done anywhere at any time. 


Disadvantages: The instructor is not directly available to the student. The 


content of course has to be designed in such away to insure that all relevant 
material is included. 


C: DATA GATHERING 

To determine which course type is best suited for conversion to an alternative 
learning method requires critical evaluation. The course objectives must be attainable 
while fitting the constraints of resource limitations and student learning styles. The 
distance learning course content and presentation vary with complexity and are 


dependent on the depth of skill and knowledge of the developer. The distance learning 
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production and delivery costs are dependent on how elaborate a courseware product is 
developed. 

Many data variables should be considered in order to establish a comparative per 
unit cost of different course delivery methods. These variables center around three 
analysis areas: course development, presentation, and cost per student. This data could 
be used through a variety of costing formulas to derive a cost per unit of learning for each 
method evaluated. The data to be gathered includes: 


us Expense Categories and Related Variables 


l. Instructor Salary 
Bay Student Salaries 
3. Average Class Size 


4. Meals, Travel and Incidental Expenses for Staff 

3) Meals, Travel and Incidental Expenses and Lodging for Students 
6. Office Supplies and Expenses 

fe Program Materials and Supplies 

8. Printing and Reproduction 

9. Outside Services 

10. | Equipment Rentals 

11. | Equipment Maintenance 

12. ‘Facilities Rental 


13s Other Miscellaneous Expenses 
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Standard Cost Variable 
Student Related Expenses 


Number of students 

Number per Class 

Number of Graduate Education Sessions Needed 
Length of Graduate Education Session (in hours) 
Student Salary per Hour 

Total Cost of Student Salaries 


Cost of transporting students to a learning center 


Total Instructor-Related Expenses 


Number of Graduate Education Sessions 

Length of Graduate Education Session (in hours) 
Number of Instructors per Graduate Education Session 
Initial Instructor Prep Time 

Instructor Preparatory Time per Session 

Instructor Salary Per Hour 

Travel Time To/From Education site 


Total cost of Instruction Salary 


Total Other related Expenses 


Number of Graduate Education Sessions Needed 
Total Cost of Classrooms 

Cost of Equipment per-Student 

Number of Students 

Total Cost of Equipment 

“Sunk” Cost to Develop Student Materials 

Cost per Student for Materials 
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5. Marginal Cost Variable 

For an additional approach that utilized a different set of variables, a Master’s 
Thesis was dedicated to establishing research about savings. See NPS Master’s Thesis, 
“A Methodology for Determining the Marginal Cost Per Student at the Naval 
Postgraduate School”, by John P. Eckardt, 1997) See Appendix C in this thesis or see 
page 42, Figure 3.9 in reference named Cost per Curriculum Model Output Page. 

4. Contribution Cost Variables 


* Revenue or Savings 
Student and Instructor Salaries and Fringe Benefits 


* Traceable Variable Costs 
Student Materiel cost 
Instructor Grading Fees 
Instructor Salary and Fringe 
Student Salary and Fnnge 


> Traceable Fixed Variable Costs 
Course Development Fees 
Editing and Printing 


e Common Variable Costs 
Course Development 


a. Formulas Used for Evaluation 
(1) Return on Investment 


Return on Investment: annual savings 
average investment 


(2) Payback Period 


Payback period: total investment 
annual savings 
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(3) Unit Cost 


Unit Cost: total traceable variable, fixed and common costs 


studentsxclasshoursss—(‘éC;COC~*# 
b. Comparison Cost from Outside Sources 
(1) Civilian Universities. Using the Peterson’s Guide to 
Distance Learning, 1998 the graph below shows a range of student per unit costs by 
university for a mix of DL delivery methods. Note the data were randomly selected from 


universities that had graduate level accounting courses available. 











|__University | Unit Dollar Cost Dollar Cost 


(ce Se a a a ee 
| Colorado 
[National [$200 
[New York 
| Old Dominion [sit ST 
[Roses | SSCiSOSSC“‘“SO#‘éQ{NR®CC~*~*d 
[Alabama [$105 8150 
wes si SCC~C~‘dS“‘C SCC 
[_UCBekey [| —OiSSSC“‘“(SSC*~‘“‘R SC 
PAlaska [8 
[Average | SCSOCC~*~“‘SSO#O#‘#QS‘C*d 


a ed 


| 
4 
{ 






(2) Cost Savings. In evaluating Distance Learning Conversion 
Costs, it was discovered that by developing a NBI course versus administering a three 
week Seminar at the Naval Postgraduate School would result in an estimated saving of 
$23,683.00 per seminar. The NPS Master’s Thesis, “Cost Effectiveness Analysis of 
Converting a Classroom Course to a Network-Based Instruction Module,” by Samantha 


Green December 1997 addressed conversion costs of distance learning. 


4] 


c Cost of Course Conversion Quotes = 
Conversion Cost estimates per 3.5 hour module: 
Vendor #1 quote $77,321. 

Vendor #2 quote of $58,300 to $68,300. 


IDEA estimates from literature and course conversion history $20,000 to 
$50,000 (per converted hour). 
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V. COST DATA ANALYSIS = 


A. ASSUMPTIONS 
The only costs that are relevant to a cost benefit analysis decision are those costs 


that vary directly with changes in volume of instruction. 


B. COST COMPARISON/SAVINGS 







Cost Savings Derived by Not Having Student Attend | 
NPS Classroom Instruction | 
A Costs Saved 
Student Salary - 
Book Reimbursement | 
Savings 
Traceable variable 
Instructor Grading Fee (or salary and Fringe) | 
! Student Materiel cost 
_B Total traceable Variable 
A-B=C_ Contnbution Margin | 





Traceable Fixed | 
Course Development Fees | 
: Editing and Printing | 
| D Total Traceable Fixed 
| C-D=E Course Contribution 


Common Costs | 
Course Development ! 

F Total common costs | 
E-F=G Net avoided | 





Unit Cost: total traceable variable. fixed and common costs 


students x class hours 


C; APPLICATION TECHNIQUES 


Interpret results of three teaching methods against costs. 


ROI Annual Savings 
Average Investment 


Payback = Total Investment 
43 A ny Dak Ge ain 4) te 


Annual Savings . 
Unit Cost Total Direct Cost 
Student Course Hours 


Ike Cost Variable Interpretation 
® Savings are what is not lost by sending a student to a full time education. 
. Expenses are associated with course development, presentation and 


students in a full time education status. 


D. CONCLUSION OF ANALYSIS 

It is conceivable that a comparative analysis could be done if relevant and reliable 
data was currently accessible. It would be of benefit to collect relevant variables for 
comparative analysis. 

Computer based instruction is best measured by utilizing the payback method due 
to the high one time front end cost. 

For the best results, conversion of any course must meet the need of the 
organization and the individual student’s learning style. 

The more interactive the student is with the learning material the better outcome 


for the organization can be expected. 


44 


VI. CONCLUSION AND RECOMMENDATIONS 


Organizational effectiveness is the result of both efficient utilization of resources 
and effective teaching to meet expected and measurable objectives. The current 
governmental impetus to curtail spending has led to both a downsizing of personnel and 
the desire to use the remaining personnel in a more economical, efficient and effective 
manner. In the educational arena this is a “Catch 22” in that the result implies that 
military officers should obtain masters degrees to advance in rank, but the cost of 
providing such education should decrease without disregarding the investment previously 
spent on these officers in obtaining their current specialty qualification. 

As an example, a very large investment is required to train a Naval Aviator. 
There is a strong resistance to having this aviator leave flying duties during the career 
period in which he is eligible to attend the Naval Post graduate School. Unfortunately, as 
he gets older (and therefore, past his time of being a warrior), the Navy often loses him to 
commercial aviation. If he had gained relevant graduate education prior to that time, he 
might have remained in the Navy with a different “p-code.” 

If some component of graduate education could be delivered in another way 
(correspondence courses, Internet based, VTC, etc.), DoD might be able to provide the 
requisite education despite economic constraints. The development of distance learning 
alternatives could be done within NPS or outsourced. 

This thesis recommends NPS conduct further research to design a data base to 
collect reliable and relevant cost data to support future cost studies focusing on course 
delivery options, including Distance Learning, as these options relate to coureware 
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development and delivery costs and learning outcomes. One should also compare the 
equivalent existing distance learning courses for content currently offered at various 
institutions other than NPS for consideration as possible substitutions for NPS classroom 
instruction or as an alternative to “building” this courseware in-house. These courses 
could be recommended for students desiring degrees accredited through NPS but unable 
to participate in full time residential graduate education at the present time. This could 
shorten the overall time spent out of the workforce as well as increase the number of 
higher education degrees attained by our military and civilian personnel. 

Given the availability of distance learning technologies, the availability of the 
Internet as a communications channel, and the potential of distance learning courseware 
authoring software to create, deliver and mediate student centric learning, the NPS should 
perform cost and learning outcome studies in order to make correct decisions regarding 


the distribution of education on the Internet. 
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APPENDIX A. GLOSSARY 


Air National Guard (ANG): A wartime mobilization force providing personnel and 


aircraft to augment the active duty forces. 


Air Technology Network (ATN): The Air Force education and training interactive 
video Teletraining network. Created in 1992 to broadcast the newly-required acquisition 
courses, ATN has expanded to four Uplink sites at Wright-Patterson, Maxwell, Sheppard 
and Keesler Air Force bases with more than 70 downlink receive sites typically located at 
the base education offices. The system used 1l-way video, 2-way audio over a 
compressed digital video signal. Combined with ANG’s Warrior Network, the Air Force 
can reach almost 300 sites with in the US. 


Analog: A format in media, which captures and presents information in a continuous 
signal or stream. Unlike digital format, which encodes information into discrete bits, 
analog formats are continuous. Traditional analog formats include paper, photographs, 
film, video, photographs, and magnetic tape, all of which are readable without additional 


interpretation by computer software and hardware. 


Asynchronous: Transmission which does not occur simultaneously with the audio and 
video associated the broadcast. Fax and computer responses system would be considered 
to operate in the asynchronous mode. Also refers to a DL delivery method that is learner 


centric and does not require “live” student-faculty or student-student interaction. 


Audio Bridge: Specialized equipment that permits several telephone lines to be joined 


together in a conference call. 


47 


Bandwidth: The frequency width needed to transmit a communications signal without 
excessive distortion. The more information contained in a signal, the more bandwidth it 


requires for distortion-free transmission. 


Binary Code: The basic level of digital electronic records consisting of bits (individual 


binary digits recorded as ones and zeros) making up bytes (a set of eight binary digits). 


Compact Disk (CD): An optical disk on which digital text, audio, video, and graphics 
data is stored. Most CDs are read-only (CD-ROM: read only memory), although 


_ recordable Cdis (CD-Ris) are available that require record-capable hardware. 


Computer Assisted Instruction (CIA): A term referring to courses delivered using a 


personal computer using floppy disks, CD-ROMs, or Internet-delivered courseware. 


Computer Based Instruction (CBI): The same as computer assisted instruction. 


Computer Based Training (CBT): The same as computer assisted instruction. CAI 
and CBI may be used to provide: Training CBT or Education CBE. 


Compact Disk-Read Only Memory (CD-ROM): A disc designed to hold up to 600 
megs of data in a digitized format. Because it 1s “read only,” users cannot alter or write 


over the data on the CD making it very popular with courseware developers. 


Compressed Digital Video (CDV): A digital transmission process used by commercial 
vendors and others to deliver TV-quality video in a way that reduces the amount of data 
required to be transmitted. While compressed video requires less bandwidth, signal 
quality is reduced. As a result, picture quality is not generally as good as full-motion, 


with quick motions often appearing somewhat blurred. 
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Computer Mediated Conferencing (CMC): Another way of conferencing using the 
personal computer and telephone lines as the communication vehicles. It provides 


instructor-student and student-student interaction in a synchronous mode. 


Contribution: The difference between revenue and variable costs. Revenue - traceable 


variable = cross margin - trace fixed = contribution. 


Crash: A catastrophic circumstance in which software, hardware, or media that store 


data cease to function, making information inaccessible. 


Department of Defense Policy of Graduate Education for Military Officers (DoD): 
Directive 1322.10 dated 31 August 1990: This directive addresses “graduate education 
requirements for military officer positions and the utilization of qualified military officers 
in those positions.” It is the policy of DoD that officer positions will be validated for 
graduate education where such education is “essential for optimum performance of duty.” 
Guidelines are also provided for the development of appropriate criteria for assigning 
graduate education requirements to billets. These guidelines are reflected in the Navy- 


specific criteria contained in NAVPERS 15938 series, Vol. I, Part B. 


Digital: Any information (text, graphics, audio, and video) that is translated into binary 


code 


Digital Media: Physical objects on which digital information is stored (e.g., magnetic 


tape, magnetic and optical disks, etc.), or collections of digital objects; service. 


Downlink: A location where equipment receives a satellite or ground based signal(s) for 
display on video, audio, or data receiving equipment. Normally downlink includes a 
room equipped for display of satellite signal(s) thorough a TV monitor and permits 


occupancy by 15 to 50 people. 
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Educational Skill Requirements (ESR): The ESR is the Pnmary Consultant’s 
definition of education requirements to be met for a specific curriculum. The ESR is 


developed and reviewed (at a minimum) biennially during Curriculum reviews. 


End Strength: The number of active-duty military and civilian personnel in the Navy on 


the last date of a fiscal year or other accounting period. 


Exportable Training: Training that is sent out or “exported” from resident course to 


field location. 


Fixed Cost: Costs that do not vary with the level of activity or volume. 


General and Administrative (G&A): Costs that do not contribute directly to a specific 


product or service, but to the overall operation of the activity. 


Hyper Text Mark-Up Language (HTML): The language of the Internet allowing 


authors to link to their items. 


Internet Based Training (IBT): A term referring to courses delivered via the Internet. 


Indirect Cost: Costs that do not contribute directly to a specific product or service, but 


to a grouping of products or services. 
Interactive Courseware (ICW): Any type of computer-controlled education or training 
that relies on student inputs to determine pace, sequence and content of training delivery 


using more than one type of medium to convey the content of instruction. 


Interactive Video Teletraining (IVT): Describes all satellite-based instruction. Also 


called video Teletraining, interactive video training and business TV. 
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Local Area Network (LAN): A system that connects computers, printers and other 
officer equipment together within a defined area (like your office building). 


Magnetic Disks (including “floppy” and hard disks): A common digital information 


storage medium similar to magnetic tape. 


Magnetic Tape: A common medium for analog and digital information storage. In 
analog use, tape is used to store audio and video. In digital applications, tape is used to 
store text, data bases, graphics, audio, and video. Magnetic tape consists of a plastic 
ribbon backing coated on one side with an adhesive material containing particles of iron 


or other material that can be magnetized to record information. 


Manual of Navy Officer Manpower and Personnel Classifications (NOCMSAN) 
NAVPERS 15839, Vol. I: This directive is issued as the principal reference manual for 
interpretation of coded entries on manpower and personnel documents and reports. Part E 
of the COCMAN lists established subspecialty codes and specifies General and Level 
criteria that have evolved over time to describe the relationship between billet 


requirements and job performance. 


Manual of Navy Total Force Manpower OPNAVINST 1000.16 (series): This 
directive implements manpower planning systems by providing information, policy, 
tasking and procedures for acquiring and effectively managing all Navy manpower. 
Chapters 4 and 6 of OPNAVINST 100.16 details the documentation and processes for the 
Navy officer subspecialty system. 


Migration: The periodic transfer of digital materials from one hardware/software 
configuration to another, or from one generation of computer technology to a subsequent 


generation. 


Multimedia: Anything that includes or involves the use of several media within 


communications. The term has evolved to refer to any system or strategy that uses a 
>) 


combination of data, graphics, video and sound. Common storage systems include CD- 
ROM devices. Combined with hypertext or computer based instruction, it becomes 


interactive multimedia. 


Open Standards: Specifications for computer system components that are proposed, 
defined, and maintained through public processes, and that enable hardware and software 
produced by different manufactures to operate together to provide ready access to 


digitally stored information. 


Optical Disks: Any of several disk formats in which digital data is etched onto a 
reflective surface and read using a concentrated light beam. Optical formats include CD- 
ROM (read only memory) CD-R (recordabele CD), DVD (digitalized video disk), and 


WORM (write once, read many times). 


Outputs: Measurable units of work or method of quantifying workload. 


Payback Period: A payback period is a very common method of evaluating a capital 
expenditure. In this approach the annual cash proceeds (savings) produced by investment 
are equated to the original cash outlay required by the investment to arrive at some 
multiple of cash proceeds equal to the original investment. Measurement is usually in 
terms of years and months. For example, if the cost saving generated from an HRD 
program are constant each year, the payback period is determined by dividing the total 
original cash investment (development cost, outside program purchase, etc.) by the 
amount of the expected annual savings. The savings represent the net savings after the 
program expenses are subtracted. The payback period is simple to use but has the 
limitation of ignoring the time value of money. To illustrate this calculation, assume the 
initial program costs are $100,000 with a three-year useful life. The annual net saving 
from the program is expected to be $40,000. The n, $100,000/40,000 equals 2.5 years 
(Phillips, 1983, p. 193). 
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P-Code: A system for coding people and billets related to specific skill requirements. 
Requires extensive knowledge of theories, principles, processes and/or techniques 
certified through the acquisition of the master’s degree for optimum performance of duty; 
also requires the conception, implementation, appraisal or management of complex Navy 


and /or DoD programs 


Planning, Programming, Budgeting System (PPBS): A system designed to assist the 
Secretary of Defense in making choices about the allocation of resources among a 
number of competing or possible programs and alternatives to accomplish specific 


objectives in our national defense. 


e A planning phase where the global threat is assessed and strategy to meet 
the threat is defined. 
® A programming phase which translates the strategic plans into programs 


defined in terms of forces, personnel, material and dollars. 
. A budgeting phase which expresses the programs in terms of biennial 


funding requirements. 


Primary Consultant (PC): The cognizant flag officer who is the technical advisor for a 


specific subspecialty code. 


Professional Continuing Education (PCE): Provides short course instruction in a 
broad range of essential educational programs to meet specific skills and functional 
competencies required in designated career fields. PCE courses provide students with the 
opportunity to think critically, plan strategically, and give them the ability to apply those 
skills and knowledge to undefined future programs and challenges. 


Professional Military Education (PME): Education in the profession of arms and the 
employment of forces. It provides and develops the skills, knowledge, understanding and 


appreciation of leaders in the nation’s armed forces. 
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Refreshing: A procedure used to maximize the life expectancy of-magnetic tapes and 
disks. In magnetic tape, refreshing involves unspooling and rewinding tapes to relieve 
stresses. In addition, data on the tapes: are transcribed and rewritten to refresh the 
magnetic signal and prevent data loss. In magnetic disks, the term refers only to the re- 


recording process. 


Return on Investment: The term “return on investment” (ROJ) may appear to be 
improper terminology for the human resource development field. The expression 
originates from the finance and accounting yield and usually refers to the pretax 
contribution measured against controllable assets. In formula form it would be the pretax 
eamings divided by the average investment. It measures the anticipated profitability of 
an investment and is used as a standard measure of the performance of divisions or profit 
centers within a business. For human resource development program evaluation, the 


return may be expressed 1n the following way: 


Return = net program benefits (or savings) divided by program costs (or 
program investment). The investment portion of the formula represents 
capital expenditures such as a facility or equipment plus initial 
development or production cost. (Phillips, 1983, p. 192). 


Satellite Education Network (SEN): The transmission system operated by the ARMY 
from FT Lee, VA. This network serves more than 60 downlinks located at Army posts 
through out the US. The SEN is compatible with ATN. 


Standard Generalized Markup Language (SGML): A standard coding system for 
creating documents that can be translated by different software into formats, links, 


graphics, etc. A commonly used type of SGML is Hypertext Markup Language (HTML) 
Strategy: The stream of decisions about how organizational resources will be configured 
to meet the demands, constraints, and opportunities within the context of the 


organization. 
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Subject Matter Expert (SME): An individual who has thorough knowledge of a job, 
duties/tasks, or a particular topic, which qualifies him/her to assist in the training 
development process (for example, to consult, review, analyze, advise, or critique). A 


person who has high level knowledge and skill in the performance of a job. 


Subspecialty Validation Review (PSVR): Replaced Subspecialty Requirements 
Review. Interchangeable with Zero-Based Review. The review of all subspecialty code 


requirements that become approved upon revalidation every two years. 


Synchronous Instruction: The simultaneous participation of students and instructors 


interaction is in real time. 


Total Force Manpower Management System (TFFMS): A simple authoritative source 
of manpower resources.- A requirements driven manpower management system that 
tracks all manpower resources (requirements, authorizations and FYDP). The TFMMS 


system pertains to billet information not personnel data. 


T-Net: A two-way video, two-way radio, slow-bit rate video system currently used by 
the Air Force Reserve Command. ATN can connect to and transmit over T-Net using 
special arrangements through Army’s Satellite Education Network at Ft Lee. Due to the 
difference in system configuration and transmission rates, receiving locations may 


experience some difficulties in receiving clear video and audio signals. 


Teleconferencing Technologies, Inc. (TTD: The manufacturer of the ATN audio 
hardware at each downlink. The TTI at each program active downlink who has 
responsibility for the acceptance, secure storage, distribution, control and return of 


assessment items. 


Teleseminar: An interactive means of instructing learners at a distance through the use 


of one-way video and two-way audio over a satellite communication link. 
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Test Administrator: Person at a downlink who has responsibility for the acceptance, 


secure storage, distribution, control and return of assessment items. 


Uniform Resource Locator (URL): An engineer’s way of saying “Homepage address.” 


It tells your browser where the file is located on the Internet and the type of file it is. 


Unit Cost: The cost per output unit or total costs for workload produced divided by 


actual number of work units. 


Unit Cost Method: A costing method that identifies direct costs per output; indirect and 
G&A costs; and develops a standard allocation rate. 

Example: it takes 3 workers to produce a chair. Each earns $15 per hour and 
together they can produce 5 chairs per hour. We estimate 300,000 chairs will be 
produced this year. 

Direct labor = $9 ($15 x3 = $45/5 = $9) 
Direct materials = $20 for wood, $3 for varnish 
Indirect costs = 600K ($600K.300,000) = $2 
G&A = $300K ($300K/3000,000) = $1 

Total unit cost = $35 


Uplink: The location where equipment permits the transmission of video, audio, and 
data signals up to a satellite. Uplinks can have multiple channels for transmission 


purposes. An Uplink normally has the capability to function as a downlink. 


Variable Cost: Items of cost that vary directly and proportionately with the amount of 


activity. 


Video Teletraining (VTT): Job site training delivered to students at their base of 


assignment via satellite over the Air Technology Network. 
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Warrior Network: The name of the Air National Guard Satellite delivery system. All 
components within the network are compatible with the Air Technology Network. The 
Warrior network has more than 200 downlinks across the US. 


Web Based Training (WBT): A term referring to courses delivered via the World Wide 
Web (Internet). 


World Wide Web (WWW): A system for sharing many different kinds of information 


over the Internet. Designed in 1989 by researchers at CERN in Switzerland, the Web is 


accessed by browsers like Netscape or Microsoft Internet Explorer. 
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APPENDIX B. EDUCATIONAL SKILL REQUIREMENTS 


IS0123 Computer Skills Development: An introduction to the use and operation of 
microcomputers with emphasis on applications in systems management. Exposure to 


pertinent software packages. 


IS 3183 Infomation Technology Management: A survey study of what constitutes 
information technology and the management aspects of developing and maintaining 
systems in support of the Department of Defense and Joint Services. Technology aspects 
of hardware. Operation system software. application software languages, database 
management, telecommunications and networking, system development processes, 
system integration, end-user computing, IT acquisition, IT organization and staffing 
issues, information privacy and security issues, and IT planning and strategies form the 
basis for management discussions. The course considers the IT management challenge: 
(1) Young Technology, (2) Sustained and Dramatic Growth, (3) Growing complexity 
associated with crating and maintaining IT systems, (4) A number of fragmented 
subspecialties exist today, and (5) downsizing and Re-engineering emphasis shifts the 
focus of application being developed from transaction based systems to decision based 
systems. Issues are discussed from the perspective of the functional manager and user of 


information systems and not that of the technologist. 


*MA2300 Mathematics for Management: Mathematical basis for modern managerial 
tools and techniques with emphasis on military applications. Elements of differential and 
integral calculus. Introduction to matrix algebra and solutions of linear systems of 


algebraic equations. 


*MN 2031 Economic Decision Making: This is a course in macroeconomics. It starts 
with a brief introduction to microeconomics scarcity, production possibility cures, and 


supply and demand. IT when proceeds to topics in macroeconomics; which include 


SY) 


national income determination, inflation, unemployment, deficits; and that banking 
system. Also covered are the various schools of thought in macroeconomics: Keynesian, 


monetarist, rational expectations, and supply side. 


*MN 2150 Financial Accounting: Study of basic accounting concepts and standards for 
reporting an organization’s results of operations, financial position, and cash flows. 
Specific topics include the accounting cycle, asset valuation, recording of liabilities and 
capital structure, and financial statement analysis. Includes discussion of the Defense 


Finance and Accounting Service and the Federal Accounting Standards Advisory Board. 


*MIN 3140 Microeconomics Theory: This course reviews traditional microeconomics 
concepts, including demand, cost, perfect and imperfect competition public goods, 
externalities, and factor markets. Emphasis focuses on several these underlying these 
concepts, including optimization, incentives, efficiency, problem soling and strategic 


thinking. Defense applications are stressed. 


*MN 3161 Managerial Accounting: Introduction to the concepts and systems of cost 
determination. Emphasis is placed on translating cost concepts into a military 
environment and relating them to pertinent OMB Circulars and Defense Instruction of 
Economic Analysis. Topics covered include job costing system, overhead accounting 


and allocation, standard costs for control, flexible budgeting, cost-volume-profit analysis. 


*MIN 3172 Pubic Policy and Budgeting: This curse analyzes federal fiscal policy with 
emphasis on resource decision making for national ane The roles o the principal 
budget process participants are examined. Executive—especially DoD and OMB—and 
congressional budget processes are assessed t indicate how national security policy is 
implemented through fiscal policy. Spending for national security is tracked from budget 
submission through budget resolution,, authorization and appropriation. Budget 
formulation, negotiation, and execution strategies are evaluated to indicate the dynamics 


of executive-legislative competition over resource allocation priorities. 
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*MN 3333 Managerial Communication: in the DOD Environment. This course 
provides DOD and International military officers and civilians with the communication 
strategies and skills needed to manage and lead in the dynamic DoD environment. 
Instruction focuses on writing informative and persuasive documents, giving succinct, 
easy to understand briefings, managing team communication processes, developing 
associates’ communication competencies through various feedback roles and strategies, 
and listening analytically and empathetically. DoD cases, scenarios, and reading are used 


to analyze complex communication situations unique to the military. 


MN 4105 Strategic Management: Study and analysis of complex managerial situations 
requiring comprehensive integrated decision making. Topics include operational and 
strategic planning, policy formulation, executive control, environmental adaptation and 
management of change. Case studies in both the public and private sectors are used. 
Particular attention is given to strategic management in the military context, and in the 


challenging DoD, DoN organizations. 


MN 4145 Policy analysis: It introduces advanced microeconomics concepts, including 
cost benefit analysis, risk, strategic interaction and imperfect information. These 
concepts are used to analyze public policy issues, stressing defense-related resource 
allocation problems. These applications emphasize optimization, incentives, efficiency, 


problem solving and strategic thinking. 


MN4151 Internal Control and Auditing: Study of the objectives and techniques of 
internal control systems and of audits of financial reports and records and of government 
operations, in accordance with Government Auditing Standards. Specific topics include 
the design and evaluation of internal control systems, audit reports, auditing standards, 


audit evidence and audit tests. 


*NS 3252 Joint & Maritime Strategic Planning: The student will have a graduate 
level understanding of strategy, especially maritime strategy, naval doctrine, and the 


effect of technical developments on warfare. The student will become familiar with the 
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following subjects for the United States, its allies, and opponents: the roles and missions 
of military services, policy-making processes regarding the armed forces, history of joint 
and general staffs, joint planning for acquisition and operations, and current issues in 


defense reform and reorganization. 


*OS 3006 Operations Research for Management: A survey of problem solving 
techniques for operations research. Topics include decision theory linear programming, 


models, project scheduling, inventory, queuing and simulation. 


OS 3101 Statistical Analysis for Management: A specialized course covering the basic 
methods of probability and statistics with emphasis on managerial applications. The 
course includes applications of probability models, statistical inference and regression 
analysis. Computation for these applications are carried out on a computer, using 
commercial software packages. Topics in probability include the binomial, geometric, 
Poisson, and normal distributions, risk and expected value. Parametric statistical 
techniques include significance testing and confidence intervals, together with point 
estimation of model parameter. Regression analysis includes simple linear regression and 
multiple regression, with estimation of parameters and test of hypothesis and confidence 


intervals for regression coefficients and the variance the error term. 
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APPENDIX C. COST PER CURRICULUM MODELS (VARIABLES) 


A = Civilian Faculty Direct Reaching Salary 

B = Include Civilian Faculty Fringe Benefits (21%) 
C = Military Faculty Salary 

D = Mission staff Direct Salary 

E = Include Mission Staff Fringe Benefits (23%) 

F = Academic Department OPTAR and Travel 

G = Indirect Costs 


Taking looking at Systems Management Department, the cost per student by this method 


resulted as listed showing an marginal cost differences that could be taken into account. 


816 SAM 463,041 12,185 


837 FM 642,136 10,884 


847 MPTA ania OD 10,375 





1 
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